Dudley  Knox  Library,  NPS 
Monterey,  CA  93943 


NAVAL  POSTGRADUATE  SCHOOL 

Monterey,  California 


THESIS 


THE 

DEVELOPMENT  OF  SELECTION  STANDARDS 
POR  THREE  NAVY  RATINGS  WHICH  VARY 
IN  LEVEL  OF  COMPLEXITY 

by 

Kelvin  W.  Nesbitt 

June  1983 

Thesis 

Ad\ 

^isor:             Richard 

S.  Elster 

Approved  for  public  release;  distribution  unlimited 


T 


20  V 


/ 


SECURITY  CLASSIFICATION  OF  THIS  PAGE  0»^mn  Dmtm  Enlmfd) 


REPORT  DOCUMENTATION  PAGE 


I.    RtPOftr  NUMSCM 


2.  GOVT  ACCESSION  NO 


READ  INSTRUCTIONS 
BEFORE  COMPLETING  FORM 


3.      RECIPIENT'S  CATALOG   NUMBER 


4.     TITLE  (and  Submit) 

The  Development  of  Selection  Standards 
for  Three  Navy  Ratings  which  Vary  in 
Level  of  Complexity 


5.     TYPE  OF   REPORT  &  PERIOD  COVERED 

Master's  Thesis 
June  1983 


S.     PERFORMING  ORG.    REPORT  NUMBER 


7.     AUTHORfaJ 

Kelvin  W.  Nesbitt 


8.  CONTRACT  OR  GRANT  NUMBERri; 


•  .  PCHFORMINO  ORGANIZATION  NAME  ANO  ADDRESS 

Naval  Postgraduate  School 
Monterey,  California   93940 


10.     PROGRAM   ELEMENT   PROJECT,   TASK 
AREA  ft   WORK  UNIT   NUMBERS 


tl.     CONTROLLING  OFFICE  NAME  ANO  ADDRESS 

Naval  Postgraduate  School 
Monterey,  California   93940 


'2.     REPORT   DATE 

June    1983 


'3.     NUMBER  OF   PAGES 


141 


14.    MONITORING  AGENCY  NAME  ft   AOORESSCif  df//«r«n(  Irom  Contrelllni  Olllcm) 


15.     SECURITY   CLASS,  (ol  thit  raport) 

Unclassified 


15«.     DECLASSIFICATION'  DOWNGRADING 
SCHEDULE 


16.     OlSTRiauTION  STATEMENT  (ol  thi*  Report) 

Approved  for  public  release;  distribution  unlimited 


17.    DISTRIBUTION  STATEMENT  (ot  Ihm  abattmct  witarad  In  Btoek  30.  H  dliUrtnt  Irom  Rtport) 


It.    SU'*PLEUENTARy  NOTES 


19-    KEY  WORDS  (Contlnu*  on  r«v«ra«  aid*  </ n«c«««arr  and  Idtnllty  by  block  numbar) 

Selection  Standards,  Enlistment  Standards,  Utility  Analysis, 
Cross  Validation,  Navy  Ratings,  Personnel  Selection,  Enlisted 
Personnel,  Navy  Cohort. 


20.    ABSTRACT  (Canlliw  an  ,«v«ra«  »id»  It  nmcmmaty  mtd  Idmntlty  by  btoek  numbmr) 

This  thesis  is  concerned  with  selection  standards  for  three 
U.S.  Navy  ratings  which  vary  in  terms  of  their  complexity.   The 
relevant  literature  is  reviewed  and  a  general  selection  standards 
approach  is  developed.   This  approach  is  then  applied  to  sub- 
samples  of  a  large  U.S.  Navy  cohort  of  enlistees  v;ho  all  had  the 
opportunity  of  serving  for  at  least  four  years.   Within  each 
rating,  prediction  equations  are  developed  which  link  various 


DO,: 


FORM 
AN  73 


1473  COITION  OF   1  NOV  tS  IS  OBSOLETE 

S/N  0102-  LF- 014- 6601  1 


SECURITY  CLASSIFICATION  OF  THIS  PAGE  (Whmn  Dmtm  Knimraa' 


SECURITY  CLASSIFICATION  OF  THIS  PAGE  (Whun  Datm  Bnfrmd) 


Block  20  (continued) 

data  available  prior  to  the  beginning  of  the  enlistee's  service 
with  three  criterion  measures  of  performance.   Analyses  are 
performed  separately  for  groupings  within  ratings  by  race  and 
sex.   Utility  analysis  is  employed  to  help  determineoptimum 
cutoffs  on  predictors.   Many  potentially  useful  predictive 
relationships  are  found  and  amongst  the  results  is  the  finding 
that  for  some  ratings,  ability  subtests  are  negatively  related 
to  criteria  of  performance.   Other  results  are  discussed  and 
recommendations  regarding  implementation  and  future  research 
are  made. 


S-N  0102-  LF-  014-6601 


SECURITY  CLASSIFICATION  OF  THIS  PAGEfW»»»n  Datm  Enfrad) 


Approved  for  public  release;  distriburicr.  unliaited. 


The  Develcpment  of  Selection  Standards 
for  Three  Navy  Ratings  which  Vary 
in  Level  of  Complexity 

by 

Kelvin    W.    Nesbitt 
Major,    Psychology    Corps,    Australian    Armv 
b.  S.,    Universi-y   of   Newcastle,     1969 
Diploma    in    Applied    Psychology,    University   of    Adelaide,     1978 


Submitted    in  partial   fulfillment   of   the 
requiremenrs    for  the   degree   of 


MASTER    CF    SCIENCE    IN    MANAGEMENT 


from   the 


NAVAL   POSTGRADUATE    SCHOOL 
June    1983 


7  AC<x>oO 


Dudlc 


-"a^ey  Knox  Library    np<? 
Monterey.  CA  93943 


ABSTRACT 

This  thesis  is  ccncerned  with  selection  standards  for 
three  US  Navy  ratings  which  vary  in  t<=rms  of  their 
complexity.  The  relevant  literature  is  reviewed  and  a 
general  selection  standards  approach  is  developed.  This 
approach  is  then  applied  to  subsamplas  of  a  large  US  Navy 
cohort  of  enlistees  who  all  had  the  opportunity  of  serving 
for  at  least  four  years.  Within  each  rating,  prediction 
equations  are  developed  which  linit  various  data  available 
prior  to  the  beginning  of  the  enlistee's  service  with  three 
criterion   measures    of   performance.  Analyses   are    perfcrmed 

separately  for  groupings  within  ratings  by  race  and  sex. 
Utility  analysis  is  employed  to  help  determine  optimum  cut- 
offs on  predictors.  Many  potentially  useful  predictive 
relationships  are  found  and  amongst  the  results  is  the 
findir.g  that  for  soie  ratings,  ability  subtests  are  nega- 
tively related  to  criteria  of  performance.  Other  results 
are  discussed  and  recommendations  regarding  implementation 
and    future   research    are   made. 


TABLE    OF    CONTENTS 


I.  INTECDUCTION 11 

II.  LITEBATURE   REVIEW 15 

A.  THEORETICAL    LITEBATURE    15 

1.  Classical   Modsl 15 

2.  Validity   and    Research    Design    17 

3.  Job    Analysis 20 

4.  Cri-erion   Selection      20 

5.  Predic-or   Selection      23 

6.  Validation 23 

7.  Cross    Validation 28 

B.  RESULTS    FECM    PREVIOUS    RESEARCH    .29 

1.  General  Results .    ,    ,    ,  30 

2.  Military   Research      33 

C.  SUMMARY        37 

1.  Theory 37 

2.  Empirical   Results •   .  38 

III.  AIM    AND    PURPOSE   OF    THIS    RESEARCH UO 

A.       PURPOSE    OF    RESEARCH 40 

3 .       AIM        '4  1 

C.  DESIGN 41 

D.  RESEARCH  HYPOTHESES 42 

1.  Hypothesis  1 42 

2.  Hypothesis  2 42 

IV.  METHOD 43 

A.       NAVY    RATINGS    SELECTED 43 

1.  Ships   Serviceman    (SH)       44 

2.  Personnelman     (PN)       .45 


3.      Aviaticn   Technician    (AT) U5 

B.  DATA    BASE 45 

C.  VARIABLES    IN    THE    DATA    BASE 46 

1.  Criterion   Variables      47 

2.  Predictor   Variables      48 

3.  Moderator   Variables      48 

4.  Screening  of    the   Variables 49 

5.  Estimates   of    Utility 50 

D.  SUBJECTS    CHOSEN 53 

E.  STATISTICAL    PROCEDURES 56 

1.      General 56 

2..      Descriptive    Analyses 56 

3,  Predictive   Analyses      57 

4.  Estimation  of   Cat-off s 57 

V.  RESULTS        . 60 

A.  DESCRIPTIVE    RESULTS       60 

1.  SH   Groups 60 

2.  PN   Grcups .60 

3.  AT   Groups 64 

B.  PREDICTIVE    RESULTS 64 

1.  Length   of    Service    Criterion      64 

2.  Goodguy  Criterion 67 

3.  Badguy  Criterion 69 

4.  Validity    Estimates 71 

5-      Average  Validities    74 

C.  ESTIMATING   CUT-OFFS       75 

1.  LOS    Criterion 78 

2.  Goodguy  Criterion      67 

3.  Badguy  Criterion    95 

VI.  DISCUSSION 103 

A.  RESEARCH    HYPOTHESES 103 

B.  CTHER    FINDINGS 104 


VII.           SUMMi^RY     AND    CCNCLUSION 109 

APPENDIX    A:       EXAMPLE    PROGRAM    LISTINGS    3ASED    ON    PROCESSING 

SH Ill 

1.  SAS  Prcgram  to  Select  SH  from  NPS  Cohort 

D  at  a Ill 

2.  SAS    Program    to    Perform    Regressions    ...  Ill 

3.  FORTRAN   Program    used    to    Estimate    Cu~-cffs 

on   Predictors 112 

APPENDIX    E:       STEPWISE    REGRESSION    RESULTS    FOR    EATINGS       .  128 

LIST    Cc    B5FERENCES       137 

INITIAL    DISTRIBUTION    LIST    140 


LIST    OF    TABLES 

I.  Classical  Model  of  Selec-^ion 16 

II.  Total  Expected   Utility    for   a    Pradictor   Cut-off 
Value 26 

III.  Percentage   of    SHs   scoring    belcw    designated    AFQT 
Score 36 

Relative    Utilities  by   Rating    52 

Relative    Goodguy    Utilities   by    Rating    52 

Relative    Badguy  Utilities    by    Rating      53 

Possibilities   for    Selecting  Subjects   within    a 

Rating 54 

Rating  Selectees   by    Rating,    Race   and   Sex 56 

Criterion   and    Predictor   Values    for    SH   Ken       ....  61 

Criterion   and   Predictor   Values    for    PN   Groups    ...  62 

Criterion  and    Predictor   Values    for    AT    Groups    ...  63 

Stepwise    Regression    for   SH   on    LOS 65 

Stepwise    Regression    for   PN   on    LOS 66 

S'repwise    Regression    for    AT    on    LOS 66 

Stepwise    Regression    for   SH   on    Goodguy 67 

Stepwise    Regression    for   PN   on    Goodguy 63 

Stepwise    Regression    for   AT   en    Goodguy 69 

Stepwise    Regression    for   SH   on    Badguy 69 

Stepwise    Regression    for   PN   on    Badguy 70 

Stepwise    Regression    for   AT   on    Badguy 71 

Length  of   Service   Validities    by   Rating   and    Sample  72 

Goodguy    Validities  by    Rating   and    Sampi-^ 73 

Badguy  Validities    by    Rating  and   Sample    73 

Average    Validities  by  Group  and   Criterion       ....  74 

Validities   for    Jiales    by    Rating    and    Criterion    ...  75 


IV. 

V. 

VI. 

VII. 

VIII. 

IX. 

X. 

XI. 

XII. 

XIII. 

XIV. 

XV. 

XVI. 

XVII. 

XVIII 

XIX. 

XX. 

XXI. 

XXII. 

XXIII 

XXIV. 

XXV. 

XXVI.  Listing    of   SAS   Set-ap    Program:    Cohort    to    File      .  113 

XXVII.  Program    Listing  of   Stepwise   Ragression    for    SH      .  119 
XXVIII. Program    Listirg  to  Output    &  Cross    Validate    .    .    .  122 

XXIX.  Program    Listing  of   FORTRAN   Program    for   Cut-otfs  125 

XXX.  All    SH   Stepwise  Regression   Results 129 

XXXI.  All    FN  Stepwise  Regression   Results    .......  131 

XXXII.  All    AT  Stepwise  Regression   Results    134 


LIST    OF    FIGURES 

5.1  Race  Blind    Selection    for   SH    on    LOS 76 

5.2  Sace  Specific  Selection    for    SH   on    LOS 30 

5.3  Face   Blind    Selection    for   PN    on    LOS 81 

5.U  Eace   Specific  Selection    for    PN   on    LOS 82 

5.5  Eace   Blind    Selection    for   AT    on    LOS 8U 

5.6  Eace  Specific  Selection    for    AT   on    LOS 85 

5.7  Rating    Selection   fcr    PN   &   AT    Women   on   LOS      ...  86 

5.8  Race   Blind    Selection    for   SH    on   Goodguy 88 

5.9  Race   Specific  Selection    for    SH    on    Goodguy       ...  89 

5.10  Eace   Blind    Selection    for    ?N    on    Goodguy 90 

5.11  Race  Specific  Selection    for    PN    on   Goodguy      ...  91 

5.12  Race   Blind    Selection    for    AT    on    Goodguy 92 

5.13  Race  Specific  Selection    for    AT    on   Goodguy      ...  93 

5.14  Rating    Selection   for    PN   f/   AT    Women   on  Goodguy      .  9U 

5.15  Face   Blind    Selection    for   SH    on    Badguy 96 

5.16  Race  Specific  Selection    for    SH    on    Badguy    ....  97 

5.17  Race  Blind    Selection    for   PN    on    Badguy 98 

5.18  Race  Specific  Selection   for    PN    on    Badguy    ....  99 

5.19  Race   Blind    Selection    for   AT    on    Badguy      ....       100 

5.20  Race   Specific  Selection    for    AT    on    Badguy    .    .    .       101 

5.21  Rating    Selection   for   PN    &  AT    Women   on  Badguy    .       102 


10 


I.    IHTRODDCTION 

The  Armed  Forces  in  many  countries  have  been  orient 
users  of  the  psychological  techniques  of  selection  and 
classification.  The  Forces'  involvement  wi-h  -hese  proced- 
ures has  been  for  such  a  considerable  period  of  time  that, 
in  fact,  it  could  be  argued  -ha-  the  development  and  refine- 
ment cf  these  techniques  has  been  greatly  enhanced  by  -he 
manpcwer  demands  of  the  military.  In  war,  and  in  prepara-ion 
for  war  (i.e.  mobilization),  the  military  required  -echni- 
ques  which  allowed  the  assesssment  of  -he  training  capabili- 
ties of  prospecTiva  civilians  for  their  rapid  transition 
from  civilian  to  uniformed  status.  It  was  inefficient  to 
have  every  potential  enlistee  embark  on  a  course  of  training 
when  psychometric  tests  could  be  used  to  exclude  those 
individuals  with  the  lowest  chances  of  success.  Since  the 
Second  iicrld  War,  the  peace  time  forces,  largely  through  the 
develcpient  cf  more  complex  weapons  systems,  have  come  -o 
demand  much  more  specialized  manpower  skills.  The  Forces' 
requirement  for  selection  and  classification,  thsrefcra,  has 
not  only  involved  making  military  personnel  out  of  civilians 
(i.e.  selection),  but  also  dealt  with  the  correct  placement 
of  enlistees  by  military  occupation  (i.e.  classification). 
Both  the  size  and  the  diversity  of  the  Armed  forces' 
manpower  requirements  have  make  it  a  very  fertile  testing 
ground  for  the  application  of  these  psychological  proced- 
ures . 

The    present    thesis      is    concerned    with    the      refinement    of 

selection        standards        for      three        employment         categories 

(ratings)    in  the   United   States   Navy.       The   three   ratings   have 

been    chosen   on       the    basis   of   the    complexity    of      the    tasks   in 

the    ratings.        In      increasing   order   of   complexity      they   are: 
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ship's  Serviceman,  Psrsonnelman  and  Aviaiion  T^chnici^n.  Ail 
three  ratings  have  currently  applied  tssx  score  entry  stand- 
ards bas-id  on  the  Armed  Services  Vocational  Aptitude  Bat*sry 
(AS7AB)  .  The  aim  is  to  examine  the  possibility  cf  improving 
the  selection  cri-eria  for  each  rating,  taking  into  account 
rating  specific  utilities  of  correct  and  incorrect  selection 
decisions.  At  the  same  time,  the  selection  standards  across 
jobs  will  be  compared.  Such  an  inter-job  analysis  will 
illustrate  the  relationship,  if  any,  that  job  complexity  has 
with  the  selection  standards.  This  latter  analysis  will  be 
qualitative  (what  kinds  of  predictors  are  mere  suited  to 
what  type  of  job)  and  quantitative  (how  does  the  level  of 
accuracy   of   selection   vary    with    job   complexity)  . 

Selection  standards  research  for  the  US  Navy  is 
important  for  a  large  number  cf  reasons.  From  the  point  of 
view  cf  manpower  planning,  better  selection  standards  may 
mean  smaller  training  attrition,  better  job  performance, 
longer  careers  and  mere  rapid  promotion.  These  outcomes  have 
the  effect  of  lifting  the  burden  of  maintaining  the  Navy's 
end  strength  from  new  enlistments  by  having  greater  numbers 
in  the  career  force.  This  has  even  more  significance  with 
the  projected  decline  in  the  services'  traditional  mantower 
pool  over  the  next  decade,  particularly  in  that  when 
manpower  resources  are  scarcer,  the  disutility  of  rejecting 
potentially  successful  applicants  is  much  greater  than  it  is 
in  the  current  recruiting  climate.  In  a  broader  con-^ext, 
current  government  regulation  explicitly  forbids  selection 
practices  which  may  have  adverse  impacts  on  minority  or 
other  groups  in  the  community  (Uniform  Guidelines  on 
Employee  Selection  Piccedures,  1978)  without  first  investi- 
gating the  use  of  "alternative  selection  procedures  that  are 
equally  valid,  but  that  produce  less  adverse  impact"  (Feilly 
and      Chac,       1982).  It   is      encumbent      upon    all      employers, 

including  the  US      Navy,      first   to   determine      the    validity   of 
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their  current  procedures  and  then  to  examine  rhe  possibility 
of  using  alternative  methods  which  may  either  improve  on 
these  standards  or  are  equally  valid  standards  which  have 
less  adverse  impact.  Thus  there  is  a  strong  extrinsically 
initiated  incentive  for  an  organization  zo  be  interest =d  in, 
and  tc  be  able  to  measure  the  validity  of,  its  own  selaction 
procedures. 

There  is  a  wealth  of  research  on  selection  standards 
both  in  the  US  Navy  and  in  many  other  employment  settings. 
Given  the  aim  of  locking  at  selection,  in  relation  tc  the 
complexity  cf  the  job  and  the  validity  of  the  procedures, 
the    next      chapter   is      devoted   to      literature   surveys.  The 

first  section  deals  with  the  theoretical  aspects  of 
selection  research,  while  the  second  is  a  review  of  the 
findings  cf  previous  research  regarding  those  factors  which 
seem  most  predictive  cf  job  success,  in  general,  and  for  the 
services    in    particular. 

The  third  chapter  brings  the  information  of  the  previous 
one  together  so  as  tc  make  a  clear  statement  of  the  purpose, 
aim,    design    and    expected    outcome    of    the    research. 

Chapter  four  deals  with  the  method.  First,  the  subject 
ratings  are  described.  This  includes  a  description  cf  sacb. 
rating,  the  standards  currently  applied  and  an  examination 
of  the  paths  through  which  individuals  enter  the  ratings. 
It  will  include  the  complexity  grading  cf  each  rating.  Next 
comes  a  description  of  the  data  base  for  this  research: 
where  it  ccies  from,  what  is  included  and  an  assessment  of 
the  quality  cf  the  data.  In  tha  next  section,  the  personnel 
are  described.  This  is  followed  by  a  section  which  concerns 
the  criterion  measures  and  predictors:  What  are  they?,  and. 
How  they  are  measured?  Another  section  describes  the  esti- 
mates of  the  utility  of  correct  predictions  and  the  disutil- 
ities associated  with  misclassif ications.  Next,  the 
cross-validation   procedures      used   for    the    estimation      of   the 
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vali'Sixy    coefficient    are   described.  Finally,      the   statis- 

tical  techniques    are    discussed. 

Chapter  five  concerns  results.  The  firs-  sec-ion  -ieals 
with  descriptive  statistics  for  each  of  the  three  ratings, 
which  includes  age  distributions,  racial  and  sex  mixes  as 
well    as    prior  education   levels.  The   next,   section   concerns 

the  results  from  using  regression  techniques.  The  final 
section  presents  results  in  which  the  direct  effects  of 
selecticr  cut-offs  are  examined  with  respect  to  maximising 
total   expected    return   for   the    selected   procedure. 

Chapter  six  is  for  the  discussion  of  the  results.  It  is 
divided  into  two  sections:  expected  outcomes  and  other  find- 
ings. Particular  attention  is  paid  to  across  rating  compar- 
isons. 

Chapter  seven  provides  a  summary  and  a  statement  of  the 
conclusions    and    recommendations. 
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II.    LITEBATURE_REVI3H 

The  purpose  of  this  chapter  is  to  review  seme  of  th?» 
literature  relevant  to  selec-ion  standards  research.  The 
first  section  deals  with  a  general  overview  of  the  technical 
and  psychclcgical  aspects:  How  should  selection  standards 
be  established?  What  is  the  concept  of  validity  and  how  ices 
it  apply?  What  types  cf  experimental  design  are  possible  and 
appropriate  in  this  type  of  research?  Then,  in  more  de-ail 
specific  theoretical  issues  are  addressed.  These  are  job 
analysis,  criterion  selection,  predictor  selection,  valida- 
tion and  cross  validation.  The  second  section  reviews 
research  conducted  specifically  in  selection  and/or  attri- 
tion. These  questions  are  addressed:  What  variables  have 
been  found  to  be  predictive  of  success  in  the  work  environ- 
ment? Specifically,  what  variables  are  associated  with 
success  in  a  service  environment?  And  finally,  what  factors 
predict  success  in  a  Navy  environment?  The  final  section 
provides  a  summary  cf  the  theory  of,  and  the  previous 
research    m,   selection. 

a.       THEOFETICAL    LITEBATORE 

1 .      Classical   Model 

fl  classical  mcdel  for  establishing  selection  s-^and- 
ards  is  suggested  by  Drenth  (1971)  .  Like  mos":  classical 
approaches  it  is  probably  never  rigidly  applied,  however 
Drenth' s  suggestion  gives  a  good  description  of  the  steps 
involved  and  is  a  useful  starting  point  for  this  section. 
These    steps   are    summarised    in   Table   I. 
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Class. 

TABLE    I 
ical  Model   of  Selection 

step 
Step 
Step 
Step 
Step 
Step 
Step 

1. 
2. 
3. 

u. 

5. 
6. 
7. 

Job    Analysis 

Choice    of   a   Criterion 

Try-out    Series   of    Tests 

Testing   of   Experimental   Group 

Validation  of   Tests 

Cross   Validation 

Tests    in    Final    For:ii 

Source 

:   Dr 

enth, P 

"Theory   and   Methods 
of   Selection",    1971 . 

1    _. 

J 

The  first  task  is  a  job  analysis  in  order  that  the 
psychological  r aquir eients  of  the  job  can  be  understccd.  In 
this  step  it  is  necessary  tc  convert  the  description  of  th^ 
job  into  specific  factors  or  variables  which  are  defined 
and,  hopefully,  are  measurable.  The  second  task  is  tc  deter- 
mine the  criterion  which  is  the  operational  means  of 
measuring  an  employee's  job  performance.  A  knowledge  of  the 
criterion  value  should  permit  a  ready  dif f erenxiation  of  the 
good  perfcrmers  from  the  poorer  ones.  Ideally,  i-^  will  be  a 
metric  or  ordinal  scale  which  will  indicate  ranges  or  grades 
cf  performance.  In  the  third  step,  t.he  jcb  analysis  is  used 
to  make  an  'educated'  guess  as  zo  wha-  kinds  of  tests  or 
c-her  factcrs  are  important  for  predicting  success  in  the 
job    for      which    the    standards      are   designed.  The    preceding 

sreps  are  necessary  precursors  to  the  nex-  group  which  deal 
with  the  empirical  pcrtion  cf  the  process.  The  fourth  step 
consists  of  the  try-cut  (or  pilot)  tests  which  are  adminis- 
tered tc  a  representative  sample  of  the  population  for  which 
the  standards  are  tc  be  developed.  Scores  or  results  are 
recorded   and  retained   while    the   employees   are   given    a    period 
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of  tiire  -tc  ferform  on-the-job.  In  stap  five,  these  subj^scrs 
are  measured  on  the  performance  criteria  developed  in  step 
two,  and  the  results  are  correlated  with  "he  test  scores 
gathered  in  the  previous  step.  From  this  analysis  xha  merit 
of  each  test  is  determined  leading  to  the  a  choice  of  tests 
most  useful  for  selection  and  their  appropriate  cut  off 
scores.  Step  six  is  critical:  the  cross  valida-ion  of  the 
selection  standards  fcr  new  group  of  subjects.  In  this  step 
the  same  procedure  as  applied  in  steps  three  to  fiv?  is 
repeated  using  the  chosen  selection  tests.  S"^ep  seven  is 
largely  administrative.  The  selection  tests  are  set  up  in  a 
standard  form.  For  small  organisations  this  step  may  net  be 
essential,  but  for  larger  ones  the  standardization  of  the 
tests  is  highly  desirable,  especially  where  there  niay  be 
several    different   testing   stations. 

The  Drenth  classical  model  is  a  very  simplistic 
scheme  of  the  procedure  for  establishing  selection  stand- 
ards. For  one  thing,  it  appears  to  assume  that  the  organiza- 
tion has  no  selection  procedures  in  existence,  simply 
allowing  individuals  to  drift  into  occupations.  While  it  may 
not  be  strictly  formalised,  the  organization  probably  has  a 
good  notion  cf  what  is  required  in  the  job  and  applies  this 
information  as  a  screening  device.  Despite  these  limita- 
tions, tha  model  alludes  to  some  very  important  issues  which 
are    discussed  in   the   subsequent   paragraphs. 

2 .      Validity   and    Besearch    Design 

Validity  is  a  very  important  issue.  In  the  simple 
case  above,  it  is  described  as  some  means  cf  comparing  the 
selection  test  results  with  subsequent  performance  in  order 
to  validate  selection  standards.  Validity  answers  the  ques- 
tion: do  these  test  scores  tell  us  a  sufficient  amount  about 
the  individuals'  subsequent  performance  so  that,  based  only 
on    a    knowledge    of  their   selection   test   results,      one    is   able 
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to      chco£€    the      better   perfcrmers.  Statistically,      it      is 

usually  repesented  ty  a  correlation  coefficient  which 
expresses  the  degree  of  association  between  the  selection 
test    scores   and    the    measure    of   subsequent    performance. 

Two  main  types  of  research  designs  have  been  defined 
with  respect  to  selection  validation.  These  are  predictive 
and  concurrent  validity  (see  Tiffin  and  ^5cCormack,  1970). 
Predictive  validity  is  that  implied  in  the  model  above: 
selection  tests  are  given  to  a  group  of  applicants  and  then 
at  seme  later  data,  criterion  measures  of  cerformanc3  are 
made.  The  test  scores  and  criterion  measures  are  then 
compared.  For  concurrent  validity  design /  the  tests  scores 
and  criterion  msasurss  are  gath3r3d  virtually  at  the  sam?; 
time.  For  both  types,  the  tests,  or  a  subset  of  the  tests, 
are  considered  valid,  if  the  correlations  are  large  enough. 
Until  recently,  the  predictive  validity  design  was  consid- 
ered far  superior  than  concurrent  validity  approach  (Drenth, 
1971).  Hcwever  Barrett  et  al  (1981)  persuasively  argue  that 
the  evidence  does  not  support  this  position.  They  suggest 
that  a  large  number  of  independent  studies,  including  a 
recent  meta  analysis  of  537  separate  studies,  have  indicated 
virtually  no  difference  between  the  magnitude  of  the  validi- 
ties found  fcr  concurrent  and  predictive  designs.  They  also 
cite  one  researcher  who  specifically  compared  the  two 
designs  in  a  national  validation  of  selection  procedures  for 
male  transit  bus  drivers  and  found  that  the  validity 
coefficients        were        comparable.  These        arguments        are 

convincing  but  what  are  the  significant  differences  between 
the    two    validation    designs? 

Guicn  and  Cranny  (1982)  suggest  that  the  key  differ- 
ence is  that  for  predictive  designs  there  is  a  lapse  of  time 
between  tsst  and  criterion  measurement  whereas  in  concurrent 
designs  the  measurements  are  made  simultaneously.  However, 
there    is      a    second    fundamental      difference    between      the   two: 
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predictiv?  designs  invariably  test  groups  cf  applicanis, 
rather  than  employees,  as  tasted  in  concurrent  designs. 
There  are  some  problems  for  concurrent  designs  in  relation 
to  the  restriction  of  range  of  tests  scores.  The  eniployees 
who  are  the  subject  cf  concurrent  designs  have  been  prese- 
lected contributing  tc  a  narrowing  of  the  range  of  data.  As 
is  noted  by  Hammer  and  Landau  (1981,  p.  576),  range  restric- 
tion shrieks  the  feasible  range  of  the  correlation  coeffic- 
ient; that  is,  its  feasible  maximum  value  becomes  less  than 
one.  Predictive  designs  are  not  completely  free  frcm  corre- 
lation problems,  since  there  is  a  time  difference  between 
tests  and  criteria.  Scores  on  the  latter  may  well  be  due  tc 
factors  other  than  those  implied  by  the  tests  scores. 
Intervening  variables  (e.g.  training  factors,  CiOtivational 
changes)  could      also        inhibit      criterion        perf  crniances. 

Additionally,  attrition  may  reduc3  the  size  of  the  group  so 
that  there  are  fewer  individuals  available  for  criterion 
measurement  than  were  crginially  tested.  It  can  be  s=en  that 
both  concurrent  and  predictive  designs  are  susceptible  to 
shrinkage   of  validity  coefficients. 

While  it  seems  only  logical  for  an  or ganiza-^icn, 
particularly  a  large  one,  to  have  valid  selection  proced- 
ures, government  regulation  has  a  significant  impact  on 
these  procedures  requiring  employers  to  have  selection 
systems  which  have  been  tested  through  a  general  validity 
model.  Hsu  (1982)  points  out  that  the  Uniform  Guidlines  on 
Employee  Selection  Procedures  (1978)  specify  "that  a  neces- 
sary condition  for  use  of  a  selection  procedure,  when  that 
procedure  produces  adverse  impacts  on  the  hiring  rates  of 
certain  minority  groups,  is  that  this  procedure  be  demons- 
trated valid"  (Hsu  1982,  p.  509)  ,  but  that  this  is  not  a 
sufficient  condition  for  its  use.  Hsu  explains  that  fcr  an 
organisation  to  use  any  existing  selection  procedure  that 
produces      adverse   minority      impacts,         it      must    have      higher 
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validity  than  alternatives  which  have  no  adverse  inipacrs. 
Many  civil  actions  have  been  won  during  the  last  decade  by 
employees  (see  Rcwland  et  al,  1980,  pp.  64-85)  against 
employers  who  have  had  selection  systems  for  which  -he 
validity  has  been  unknown  or  inadequately  established.  So 
there  is  a  considerable  amount  of  external  pressure  for  the 
organization  -co,  first,  know  what  the  validity  of  its 
procedure  is,  and  to,  second,  establish,  in  the  case  -chax 
there  are  adverse  impacts,  that  there  is  no  alternative 
system  which  is  equally  valid  that  will  produce  a  less 
adverse    impact. 

Given  this  general  overview  of  the  technical  litera- 
ture, it  is  now  possible  to  deal  in  more  detail  with  ether 
issues. 

3  •      Job   Analysis 

It  is  probably  a  fairly  safe  assumption  that  very 
few  attempts  at  introducing  selection  standards  begin  with  a 
thorough  job  analysis  (such  as  is  described  in  Dunnstte, 
1976,  Chapter  15).  This  is  so  for  a  variety  of  reasons,  not 
the  least  of  which  is  that  it  is  very  time  consuiping  and 
requires  a  considerable  amount  of  effort  with,  at  best,  very 
little  by  way  of  quickly  identifiable  return  for  these 
labours.  A  job  analysis  is  not  part  of  this  research,  tut 
Chapter  IV  includes  a  brief  job  description  of  the  three 
Navy  ratings  involved,  in  order  to  put  them  into  an  appro- 
priate context.  Presumably  thorough  job  analyses  hav=  b^en 
done  for  these  ratings  and  used  for  the  development  of  the 
selection    procedures. 

4 .      Criterion   Selection 

Dunnette's  bcok  ("The  Handbook  of  Industrial  and 
Organizational  Psychology",  1976)  has  two  excellent  chapters 
on   the   selection   of    an      appropriate    criterion,      which   is   the 
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second  step  in  Table  I.  This  is  perhaps  the  hardest  step  of 
all  and  has  been  one  cf  the  "key  problems  in  industrial  and 
organizational  psychology,  as  evidenced  by  the  massive 
efforts  designed  to  clarify  its  theory  and  improve  its 
measurement"  (Smith,  1976,  p.  745).  Smith  specifies  -^hree 
requirements  of    a   criterion    of    performance: 

a.  that  it  be  relevant  of  some  organizational  or 
individual      goal,      but  neither      biased   nor    trivial; 

b.  that  it  be  reliable  and  "involves  agreement  between 
different  evaluations,  at  different  periods  of  time 
and  with  different  although  apparently  similar 
measures"     (Smith,    p.    746)  ; 

c.  that  it  be  practical:  that  is,  available,  plaus- 
-itle  and  acceptable  to  those  who  will  use  it  for 
decisions. 

Another  issue  that  has  received  much  research  is 
the  choice  between  a  single  performance  criterion  and 
multiple  criteria.  In  the  classical  model,  the  emphasis  was 
on  a  single  criterion  which  met  all  the  requirements 
mentioned  above  (Guicn,  1976,  p.  783),  but  the  weight  of 
recent  cfinicn  is  towards  multiple  criteria  (Smith,  1976,  p. 
747)  .  The  first  argument  in  favour  of  the  multiple  criteria 
solution  is  on  logical  grounds:  the  various  possible 
criteria  are  all  different  ways  of  measuring  the  same 
unitary  concept  and  using  more  than  one  measure  gives  a 
tetter  estimate  cf  this  concept's  true  value.  It  could  be 
that  two  individuals  with  equivalent  total  performances 
could  achieve  these  results  through  quite  different  behav- 
iour patterns.  The  ether  arguement  for  multiple  criteria  is 
empirical:  "an  overwhelming  majority  of  studies  involving 
statistical  analyses  of  sets  of  criterion  measures  finds 
that        these     analyses        rarely      yield        a      single        general 
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factor. . .several  criterion  measures  are  necessary  to  account 
for  the  variance  in  a  criterion  correlation  matrix"  (Smith, 
1976,  p.  7U8) ,  The  choice  of  criteria  and  how  to  combine 
them  are  difficult  processes  and  must  all  too  often  be  based 
en  convenience  rather  than  -ch^^ir  r=5lsvance  to  long  term 
effectiveness. 

Several  recent  studies  have  proposed  the  use  of 
utility  concepts  in  performance  measurement  which  could  be 
used  as  a  criterion  (Landy,  Farr  and  Jacobs,  1982;  Schmidt 
and  Hunter,  1981).  Utility  concepts  include  such  things  as 
the  number  cf  successful  employees  hired,  increases  in  the 
average  level  of  performance,  and  the  amount  of  savings  in 
dollars  and  cents,  as  a  means  of  evaluating  the  effects  of 
various  selection  strategies.  Most  recent  applications  of 
utility  concepts  deal  with  the  value  to  the  organisation  of 
the  hired  individual  which  was  derived  by  estimating  the 
average  value  and  the  standard  deviation  cf  performance 
expressed  in  dollars.  These  criteria  as  they  stand  are 
inappropriate  for  the  present  study,  but  the  application  of 
utility  analysis  is  discussed  below  in  relation  to  the 
determination  of  optimum   cutting   scores    on    predictors. 

In  addition.  Smith  (1976)  suggests  several  other 
variables  which  have  been  found  useful  as  providing  "hard" 
and  "soft"  criterion  measures.  Under  tne  hard  category  are 
tardiness,  absences,  accidents,  tenure  or  turnover,  sales, 
production,  job  level  and  promotions.  Evan  these  may  contain 
some  soft  elements  largely  due  to  the  effects  cf  human 
judgements.  The  soft  criteria  are  those  which  involve  the 
use  cf  rating  scales,  usually  completed  by  supervisors. 
There  are  a  large  number  of  sources  of  rating  scale  error, 
and  an  even  larger  number  of  methods  to  minimise  their 
effects  (see  Landy  and  Farr,  1979;  Smith,  1976,  pp. 
757-76U) ,    but  these    will    not    be    considered    in    de-ail   here. 
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5 .      Predictor  Selection 

In  trying  -o  select  tests  which  may  serve  as  pred- 
ictors,   Guicn    (1976)     suggests   three   criteria: 

a.  conplex  behaviour  (i.e.  the  criterion)  cannot  b=  fully 
predicted  by  simple  means,  thus  a  single  predictor  is 
usually  inappropriate; 

b.  complex  performance  is  a  func-ion  of  the  individual, 
but  only  to  a  certain  extent,  therefore  in  thinking  of 
predictors,  it  is  pertinent  to  go  beyond  individual 
traixs  and  include  situational  and  demographic  varia- 
bles  as  sources   of    potential   pr^dicrors;    and 

c.  complex  behavior  is  not  likely  x.o  be  optimally  pred- 
icted in  precisely  the  same  way  for  all  people,  while 
it  is  not  feasible  tc  have  prediction  equations  for 
each  individual,  it  may  be  poss-.ble  to  develop 
different    equations   for    logically    different    subgroups. 

He  also  suggests  many  publications  to  consult  (e.g. 
Ghiselli,  1S66)  which  provide  a  summary  of  predictive  valid- 
ities for  various  job  categories,  by  type  of  predictor  and 
by  type  cf  criterion.  They  are,  he  suggests,  a  good  starting 
point . 

6  •      Validation 

Ic  this  point  the  concept  of  validity  has  been 
described  as  a  correlation  coefficient  which  expresses  the 
relationship  between  predictor  and  criterion  measures. 
However,  this  concept  can  be  extended.  As  noted  by  Campbell 
(1976),  the  correlation  coefficient  approach  to  validity 
implies : 

a.  "  there  is  one  normally  distributed  criterion  or 
criterion    composite; 
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b.  there    is    one      ncrmally      distributed   predictor    cr    pred- 
ictor   composire;    (and) 

c.  the   r elarionship      between      -chem    is    linear    and    horacsce- 
dastic."     (p.       205) 

These  are  stringent  conditions  and  are  often  viola-ed.  He 
further  challenges  the  practical  use  of  a  validity  coeffic- 
ient: hew  are  decision  makers  to  use  say,  the  value  of  .55, 
in  determining  which  of  a  group  of  applicants  should  be 
selected?  The  coefficient  says  little  abcu-  how  to  produce 
the  desired  outcome.  Provided  the  above  three  ccndi+icns 
are  met,  the  validity  coefficient  is  useful  for  determining 
which  of  a  group  cf  predictors  is  more  appropriate  for 
selection  but  Campbell  describes  wha-  he  calls  "decision 
centered"    validi-y   as  a   more   useful    approach. 

With  a  decision  orientation,  selection  research  is 
viewed  an  attempt  to  predict  discrete  outcomes  en  a 
criterion  which  is  categorical  in  nature.  The  categori=-s  to 
be  predicted  are  made  up  of  those  who  succeed  against  those 
who  fail.  The  task  for  the  predictor  then  is  to  establish  a 
"cutting"  score  which  maximises  the  proportion  cf  correct 
predictions.  But  how  is  t hp  proportion  of  correct  predict- 
ions to  be  defined?  In  the  equations  below,  the  figures  A, 
B,  C,  and  D  all  refer  to  the  numbers  of  personnel  by 
predictor/  criterion  outcome.  A  is  the  number  who  are  pred- 
icted to  pass  the  criterion  and  who  do,  in  fact,  pass.  3  is 
the  cumber  who  are  correctly  predicted  to  fail  the 
criterion,  C  is  the  number  who  are  predicted  to  pass  but  who 
subsequently  fail  the  criterion.  Finally,  D  is  the  number 
who  are  predicted  to  fail  but  who  would  have  passed.  Using 
these  figures,  two  examples  cf  how  the  proportion  of  correct 
classifications  may  he  defined  are  as  follows.  One  method. 
Equation  2.1,  is  tc  take  the  proportion  of  correct  class- 
ifications     over   the     total      number      to    classify.  Another 
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approach.  Equation  2.2,  takes  as  the  sratistic  the  number  of 
successes   ever    the      total   number    who    pass.  There    could   be 

Ouher  possible  definitions.  However  for  both  equations,  -he 
idea  is  to  select  a  "cutting"  score  on  the  predictor  which 
maximizes  the  value  cf  the  expression.  What  is  forgott-=n  in 
bcth  these  definitions  is  that  each  embodies  a  value  judge- 
ment     in      the   way   the      statistic    is    defined.  Equation    2.1 

CP    =     <A    +    E)/(A    +    E    +    C    +    D)  (eqn    2.1) 


CP    -     {A)/  {k   ■^    C)  (eqn    2.2) 

applies  an  equal  weight  to  borh  correct  prediction  outcomes, 
and  dees  not  distinquish  between  the  two  types  cf  error 
(categories  C  and  D  in  the  equations)  in  t^rms  of  thrir 
(negative)  value  to  the  organisation.  Equation  2.2  ignores 
completely  the  outcoires  for  individuals  who  are  not  in  the 
predicted  success  grcup,  in  effect  assigning  a  value  cf  zero 
to  each  of  these  outcomes.  The  question  arises  then  as  to 
what  values  should  be  assigned  to  each  outcome  for  the  four 
possibilities,  given  in  the  equations,  to  derive  an  appro- 
priate   cutting    score? 

The  answer  lies  in  the  application  of  the  concept  of 
utility  which  was  referred  to  briefly  above.  As  described  by 
Campbell  (1976),  utilities  are  estimated  for  each  outcome  in 
Equations    2.1      and    2.2.  For    simplicity      in    the      following 

discussion,  the  terms  pass  and  fail  refer  to  crit=rion 
results  whereas  positive  and  negative  refer  to  predictor 
score  results.  Thus,  outcome  A  is  a  pass/positive  outcome: 
these  members  are  correctly  predicted  to  pass  on  the 
criterion.  An  example  of  the  application  of  utilities  and 
how    they   are  maxinis'=d  by   varying  the   cutting   score    is    given 
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TABLE    II 
Total   Expected    Otility    for  a   Predictor   Cut-off   Value 

A.    Fixcd  relative   utilities   for   each   outcome 
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Frcducts    of    utilities   and   probabilities 
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Failure 
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Total   expected   utility    for   this   cut-off   =    2.30 


in  Table  II  (this  example  is  very  similar  to  that  given  by 
Campbell,  1976,  p.  2  12).  As  can  be  seen  from  Table  II,  part 
A,  the  pass/positive  outcome  is  given  a  value  of  10  units  of 
utility  which  is  the  same  valae  as  the  fail/negative 
outcome.  This  implies  that  it  is  as  valuable  to  the  organi- 
saticn  to  predict  a  success  as  it  is  to  correctly  predict  a 
failure.  The  negative  signs  in  the  other  two  cells  suggest 
that  each  outcome  is  a  disutility  tc  the  organisation. 
Further,  it  is  clear  that  the  relative  values  in  these  cells 
indicate   that      the    disutility      of   incorrectly      identifying  a 
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failure,  is  far  greater  than  incorrectly  identifying  an 
individual   who      would  havs      been    successful.  In    fact      the 

former  disutility  is  six  -^.imes  as  great  and  it  is  not  diffi- 
cult to  s€e  why  this  would  be  so.  Allowing  a  futurs  failing 
individual  in  to  the  organisation  is  much  more  expensive 
because  of  the  larger  amount  of  investment  which  is  lost 
(e.g.  training  expenses,  salary)  compared  with  the  rela- 
tively small  investment  lost  on  the  rejected  applicant  who 
would  have  been  a  success.  The  qaestion  remains  however  as 
to  hew  tc  use  these  utilities  in  the  deriving  selection 
cut-offs. 

To  see  how  the  utility  values  are  used  for  deter- 
mining the  effectiveness  of  a  selection  procedure,  it  is 
necessary  tc  examine  all  three  parts  of  Table  II.  Part  B 
shows  the  proportion  of  the  sample  residing  in  each  cell 
based  upcn  a  cut-off  score  on  the  predictor.  It  forecasts 
that  38^  of  the  applicants  will  be  successful.  Treating 
these  cell  entries  as  a  probability  of  belonging  to  that 
call,  it  is  now  possible  to  calculate  the  expected  utility 
for  each  cell  by  multiplying  the  probability  by  the  corres- 
ponding utility.  The  result  is  shown  in  part  C  of  the  table. 
For  a  cutting  point  cf  38%  predicted  successes,  the  total 
expected  utility  is  simply  the  sum  of  each  of  these  cells: 
2.8  is  the  expected  utility  for  this  particular  cutting 
score.  Using  this  same  procedure  the  next  possible  cut-off 
score    on      the   predictor   can      be   evaluated.  Clearly,      this 

cut-off  will  most  probably  produce  differenx  proportions  of 
cases  in  each  cell,  which  will  in  turn  change  the  value  of 
the  total  expected  utility.  Continuing  this  process  for  all 
possible  cut-offs  produces  a  total  expected  utility  for  each 
cut-off  level.  The  cut-off  which  should  be  chcsen  is  the 
one  that  iraxiraises  the  expected  utility.  Of  course  if  all 
cut-off  levels  result  in  negative  expected  total  utility, 
then  the  selection  device  is  of  no  use  to  the  organisation 
and    it   should  not   be    used. 
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within  tha  US  Navy  setting,  it  is  possible  to  make 
estimaticns  of  the  various  utilities  associated  with  each  of 
the  four  possible  pr€dictcr /criterion  outcomes  through  cost 
and  productivity  analyses  by  rating.  Utilities  for  Three  of 
the  four  possible  outcomes  appear  to  be  relatively  straight- 
forward, provided  seme  simplifying  assumptions  are  made. 
These  three  (associated  with  A,  B  and  C  in  the  equations) 
may  be  estimated  from  xhe  Billet  Cos-  Model  (Assessment 
Group,  1983).  However,  the  disutility  of  the  ether  cell, 
misclassif ied  pass  (E  in  the  equations)  is  more  difficult. 
For  the  defense  force  the  disutility  of  this  outcome  is  very 
much  a  function  of  the  recruiting  market.  During  lean 
recruiting  times,  when  quotas  are  hard  to  fill,  to  reject  a 
potentially  successful  candidate  has  greater  disutiltiy  than 
it  would  in  the  current  recruiting  climate.  The  utilities 
associated  with  the  ether  three  cells  should  be  impervious 
to  such  fluctuations.  The  actual  derivation  of  utilities  is 
discussed   in  the   Methcd   chapter. 

"^ •      Cross  Validation 

Depending  on  the  statistical  technique  employed,  the 
results  cf  selection  standards  research  will  be  effected  by 
certain  characteristics  specific  to  the  sample  used  in  the 
study  (Weiss,  1976,  p.  332).  This  means  that  the  results 
will  reflect  not  only  the  true  relationships  between  the 
critericr  and  predictor  variables,  but  they  will  also 
reflect  relationships  which  are  unique  to  that  particular 
sample,  and  this  uniqueness  may  not  be  generalised  tc  the 
population.  To  avoid  these  problems  selection  results  are 
usually    cross-validated. 

It  is  not  necessary  to  cross-validate  in  the  same 
manner  which  was  described  for  the  classical  selection 
model.  This  would  involve  the  complete  replication  of  the 
original   research  on   a  new    group   of   subjects.    ?1ore    efficient 
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and  less  costly  methods  are  availabla.  Campbell  (1976,  p. 
21U)  describes  what  he  calls  the  'double  crcss-valida+icn' 
design.  Here  the  sample  is  randomly  split  into  -i^o  equally 
sized   sucsaiples.  The   statistical    techniques      are   applied 

independently  to  each  subsample  to  derive  the  decision  rules 
for  the  final  version  of  the  selection  device.  The  decision 
rules  for  subsample  1  are  applied  to  subsample  2  and  the 
validity  estimated.  The  decision  rules  for  subsample  2  are 
applied  to  subsample  1  and  another  coefficient  is  calcu- 
lated. The  average  of  these  two  coefficients  gives  the 
validity  for  the  procedures.  Ideally,  of  course,  the  deci- 
sion rules  for  each  subsample  will  be  essentially  the  same. 
Marked  deviation  between  subsamples  indicates  that  either 
cne  cr  bcth  results  are  sample  specific  and  therefore  they 
would   be   suspect. 

The  double  cross-validation  design  could  apply 
equally  well  to  the  utility  method  for  estimating  the 
optimal  cut-off  values.  Cut-offs  could  be  determined  on 
predictors  for  one  group  and  then  compared  with  the  cutoffs 
derived    froir  these    same   predictors  on    the   other   subsample. 

B.       RESDLIS    FROM    PRE7I0DS    RESEARCH 

As  was  indicated  earlier,  there  is  a  great  deal  of 
research  literature  en  personnel  selection  within  organisat- 
ions. This  includes  studies  for  almcst  every  ccnceiveable 
employment  type  both  across  the  community  and,  within  and 
by,  the  services.  The  purpose  of  this  section  is  to  include 
sufficient  cf  the  previous  research  so  as  to  get  a  basis  for 
formulating  research  hypotheses  in  the  next  chapter.  It  is 
neither  intended  nor  claimed  that  what  follows  is  an  all 
inclusive   review  of    personnel    selection   research. 
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'J  •      Gen'?ral    Results 

The  history  of  mental  testing  is  intertwir.ed  with 
that    of      farsonnel    selection   in   organisations.  During  the 

1950  •£  and  1960 's,  many  organisations  adopred  the  IQ  as  a 
standard  leasurement  for  use  in  selection  and  placement:  in 
virtually  any  employment  setting.  But  the  whole  area  of 
human  ability  testing,  including  the  concep-  of  IQ,  came 
under  fire  in  the  late  1960's,  The  civil  rights  ncvement 
had  a  let  to  do  with  this,  as  articles  and  monographs  (e.g. 
Jensen,  1S73)  indicated  that  there  were  significant  minority 
score      differences    on      these   tests.  Further,      there      were 

claiirs  that  minority  groups  were  disadvantaged,  through  t'=st 
bias,  by  organisations  which  employed  psychological  tests  in 
their  salcction  procedures.  In  a  recent  article  Carroll  and 
Horn  (1981)  sought  tc  make  a  distinction  between  the  science 
and      the   application      of   human      ability   measurement.  They 

claimed  that  the  science  of  human  abilities  was  in  a  "hase 
of  confusion  (as  evidenced)  when  ideas  about  human  abilities 
are  regarded  as  equivalent  to  ideas  about  IQ  measurements 
(and)  that  valid  criticism  of  particular  applications  of 
measurements  are  not,  in  general,  criticisms  of  the  science 
of   ability    measurement"    (page    103).  They   argue    that    there 

is  no  particular  fault  with  the  scientifi.c  aspects  of  human 
ability  m*=a£urement ,  claiming  that  30^  of  the  variance  of 
ability  differences  is  accountable  in  test  measurement,  and 
suggesting  that  the  application  of  these  tests  has  caused 
the    difficulty. 

Schmidt  and  Hunter  (1981)  also  discuss  this  issue, 
but  in  a  more  applied  sense.  They  have  derived,  ever  the 
last  five  years  or  sc,  a  procedure  for  evaluating  the  signi- 
ficance cf  individual  validity  studies,  in  which  they  say  it 
is  sometimes  difficult  to  detect  the  presence  or  effect  of 
sampling   bias.       Specifically,      they   directly   address    many   of 
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the  criticisms  of  mental  testing  pat  forward  in  the  last 
decade.  These  include  the  notions  of  low  utility  (selection 
procedures  h^ve  little  direct  bearing  on  organisational 
productivity),  test  unfairness  (selection  procedures  are 
biassed  against  minorities)  and  test  invalidity  (selection 
test  validities  may  be  situation  or  job  specific  and  not 
truely  general).  Numerous  recent,  studies  are  referenced  in 
support  of  the  idea  that  selection  procedures  do  not  have 
low  utility.  This  leads  to  the  conclusion  that  the  potential 
effects  of  employment  testing  on  productivity  have  been 
underestiiated ,  The  authors  deal  with  test  unfairness  cy 
suggesting  that  the  factors  causing  low  test  scoras  also 
produce  poorer  job  performance,  for  both  majority  and 
minority  groups.  They  conclude  that  employment  tests  dc  not 
cause  adverse  impacts  against  minorities  and  they  seem  to 
support  Jensen  (1980),  who  demonstrated  that  when  minorities 
are  selected  on  procedures  developed  on  white  samples  th« 
minority  group  is  favoured  (see  Jensen,  1980,  p.  515).  The 
third  issue  cf  test  invalidity  is  similarly  argued  with  the 
presentation  of  many  studies  which  support  the  notion  that 
tests    ars      valid   for      employment    prediction.  One    relevant 

study  shewed  that  when  jobs  were  grouped  according  "to 
complexity  of  information-processing  requirements,  the 
validities  cf  a  composite  of  verbal  and  quantitative  abili- 
ties for  predicting  on-the-job  performance  varied  from  .56 
for  the  highest  level  job  to  .23  for  the  lowest"  (page 
1133)  .  This    is      an     interesting      finding   considering      the 

emphasis  in  this  thesis  on  selection  for  various  coicplsxity 
levels.  It  suggests,  first,  that  cognitive  ability  should 
be  valid  for  predicting  job  performance  and,  second,  that 
the  validity  should  increase  with  job  complexity.  Smith  and 
Hunter   reach  t hr =e    conclusions: 

a.      professionally      developed        ability      tests      are      valid 
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predictors      of      performance      bcth      on-the-job      and      in 
training    for   all   jobs; 

b.  ability  tests  are  fair  to  minority  groups  as  they  do 
net  underestimate  the  expected  job  perf ormar.ci  of 
minorities;    and 

c.  ability  tests  used  in  selection  can  effect  huge  labour 
and   cost    savings   in   an  organisation. 

In  contrast  to  Schmidt  and  Hunter's  paper,  which 
makes  a  frontal  attack  on  the  critics  of  ability  testing, 
Eeilly  and  Chao  (1982)  examine  the  validity  and  fairness  of 
some  alternative  selection  procedures  as  is  required  by 
government  ragulaticn  where  there  are  adverse  minority 
effects.  Cf  the  eight  alternatives,  two  a-e  relevant  for 
the  present  study.  These  are  bicgrahical  data  and  academic 
performance    oneasures.  Biographical    data      is   that      type   of 

informaticn  usually  given  by  an  application  for  a  job,  and 
includes  such  things  as  age,  number  of  years  schooling, 
marital  status  and  number  of  dependents.  These  data  have 
been  successfully  used  in  predictive  :;ross-valida  ted 
studies,  returning  validities  net  as  large  as  for  ability 
tests,  but  sufficiently  close  to  suggest  they  could  be  a 
feasible  alternative.  Academic  performance  measures,  such 
as  grade  point  averages  and  course  results,  have  net  fared 
so  well.  Validities  based  en  performance  criteria  for  these 
items  have  been  either  insignificant  or  extremely  low.  They 
are   net   recemmended    as  an  alternative. 

In  sum,  therefore,  it  is  clear  that  mantal  ability 
tests  are  relatively  valid  predictors  cf  job  performance  in 
virtually  all  settings,  and  that  biographical  data  are  also 
useful  and  valid  as  predictors.  Higher  validities  have  been 
found  for  mere  complex  jobs  when  compared  with  jobs  cf  low 
complexity. 
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2-      Military   Research 

As  was  indicated  in  the  introduction,  the  inilitary 
has  teen  a  very  fertile  ground  for  research  in,  ^nd  the 
applicaricn  of,  selection  standards  Technology.  Almost  150 
studies  en  the  US  military  were  recently  reviewed  by 
Vineberg  and  Joyner  (1982).  These  occured  between  1952  and 
1980  and  were  selected  because  they  were  job  performance 
prediction  studies.  The  authors'  paper  deal*  with  criterion 
and  predictor  variables  and  the  usual  technical  measure  of 
validity  (i.e.  the  correlation  coefficient)  associated  with 
different  combinations  of  these  variables.  This  extensive 
survey   article    is  discussed    in    the  next    few   paragraphs. 

Vineberg  and  Joyner  categorise  the  criterion  varia- 
bles uspd  in  military  studies  into  three  types:  proficiency, 
job  performance  and  suitability.  Proficiency  variables  are 
objective  type  measures  of  either  job  knowledge,  task  and/or 
task  elenient  performance.  Job  performance  is  expressed  as 
either  global  ratings,  job  element  ratings  (both  of  which 
are  subject  to  the  rating  scale  errors  referred  to  above) , 
productivity  (applied  only  to  Army  recruiters)  and  the  grade 
or  skill  level  obtained.  The  suitability  criteria  are  made 
up  of  such  things  as  length  of  service,  completion  of 
enlistment  term,  misconduct  measures  and  recommendations  for 
ra-enlistment.  Within  and  across  these  subdivisions  the 
best  median  validities  obtained  were  for  job  knowledge 
(.40),  task  performance  (.31),  suitability  (.24)  and  global 
rating  (.15)  from  a  total  of  350  validity  cceffients.  Eased 
on  these  values,  the  authors  conclude  that  the  task  perfor- 
mance and  suitability  validities  are  high  enough  to  suggest 
they    would   be   useful    in   selecting    military    personnel. 

Many  different  types  of  predictors  have  been  used  as 
the  independent  variables  in  selection  research.  The  acst 
popular   is    aptitude     (e.g.    mental   tests),    followed    closely   by 
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biographic      and    demographic      variables.  In   mosr      ap-ti-ude 

studies  at  least  one  ether  type  of  predictcr  was  us^d.  Age 
and  education  level  (expressed  as  number  of  years  schooling) 
were  the  most  frequently  used  biographical  variables.  When 
predicting  suitability  criteria,  the  variables  ag*^,  [iiental 
ability  and  education  have  consistently  been  found  tc  be 
significant.  The  median  validities  are:  education  (.36), 
mental  ability  (.2U)  and  age  (.21).  When  all  three  of  these 
variables  are  taken  into  account,  simultaneously,  then  valid- 
ities have  ranged  from  .24  to  .39.  Some  evidence  is 
presented  which  suggests  that  when  some  early  military 
experiences  are  taken  into  accoun-c  (e.g.  ra-ings  at  recruit 
training),  then  the  validities  for  prediction  range  from  the 
.40s    tc    the    .60s. 

While  the  authors  conclude  that  the  research 
suggests  the  usefulness  of  these  predictors  to  forecast 
performances  on  these  criteria,  they  make  two  relevant 
points  about  the  relationship  of  the  variables  and  how  the 
validities  may  be  improved  upon  (page  22) .  The  first  point 
is    similar     to    one    made   earlier      in   this    paper:  there    are 

likely  tc  be  many  important  differences  wi'-hin  and  across 
jobs,  and  these  need  to  be  taken  into  account  when  theor- 
ising about  what  kinds  of  relationships  exist.  Jobs  aay 
differ  in  terms  of  job  difficulty,  the  level  of  effective 
ceiling  of  performance  and  how  many  of  the  encumbents  reach 
this  level  cf  performance.  These  kinds  of  factors  affect 
what  the  criterion  measure  should  be  and  how  it  should  be 
measured.  The  present  study  hopes  to  address  specifically 
the    issue   of   job   complexity. 

Ihe  second  fcint  is  that  predictor  and  criterion 
relationships  are  not  likely  to  be  static  over  time.  With 
experience  cn-the-job,  those  predictors  which  were  useful 
for  predicting  "early"  criteria  of  performance  tend  to  "wash 
out".         It      may    be    that   as      training    and  experience      tend  to 
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make  the  differences  in  technical  proficiency  smaller  and 
less  significant,  then  predictors  are  less  able  to  discrimi- 
nate between  the  performances.  These  poinds  tend  to  empa- 
sise  the  notion  that  the  expected  relationships  between 
predictors  and  criteria  might  not  be  found  in  a  sample,  but 
also  that  there  are  probably  many  alternative  explanations 
for    insignificant   results. 

Studies  of  predicting  military  performance  have  been 
done  in  ether  countries,  with  similar  kinds  of  results. 
Some  of  the  more  recent  ones  are  summarised  by  Johnson 
(1982).  An  earlier  paper,  quite  relevant  to  the  present 
study,  was  done  by  0*Gorman  (1972).  He  studied  regular 
entrants  to  the  Australian  Army  and  found  that  a  total  of 
ten  pre-enlistment  variables  combined  in  linear  multiple 
regression  were  useful  in  predicting  an  ef f ecxiveness 
measure      cf        performance.  The      criterion        consisted     of 

assigning  the  value  "1"  to  these  who  did  not  complete  rheir 
service  for  reasons  ether  rhan  death  or  illness,  "2"  zc 
those  who  completed  three  years  without,  promotion,  and  "3" 
to  these  who  completed  three  years  and  who  were  promoted  to 
corporal  er  higher.  The  significant  predictor  variables 
included  age,  marital  sta-us,  aptixude  scores  (general 
ability  and  clerical  ability),  results  en  a  psychiatric 
inventory,    birth   order  and    prior   service. 

Mere  specifically  for  the  current  thesis,  there  has 
been  seme  recent  pilot  research  (Lurie  1981)  about  deter- 
mining selection  standards  for  the  Ships  Serviceman  ra^^ing. 
In  this  study  Lurie  attempted  to  relate  pre-entry  variables 
to  an  improved  criterion  of  Navy  success:  rather  than  the 
survivability  of  rscruits  during  their  first  term  he 
attempted  te  employ  a  job  performance  criterion  to  determine 
selection  standards.  Kis  criterion  was  a  combined  advance- 
ment and  sur  viva  lability  measure,  the  object  being  to 
predict   this      variable   given      AFQT  score,        age,      number     of 
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TABLE  III 
Percentage  of  SHs  scoring  below  designated  &PQT  Score 

Grade  AFOT  =<  20  AFQT  =<  50 

"T-l—  —   5-5 —  -83 

E-2  50  85 

E-3  45  78 

E-4  3H  70 

E-5  30  62 

Source^:   Lurie,P.E.    "Relating      Enlistment      Standards 
""  to  Job    Performance:    A   Pilot    Study 

for    Two    Navy    Ratings" 
CNA    No.    81-0048         of    15   Jan    1981. 


primary  dependents  and  years  of  education  for  a  cohort  group 
of  enlistees.  His  study  used  a  cohort  which  joined  the  Navy 
in  1973^  and  records  of  their  service  were  available  up 
until  1977,  allowing  for  advancsment  to  E5.  Regression 
models  were  used  in  calculating  the  relationships  between 
the  variables  which  allowed  for  the  construction  of  "service 
status"  protabilit ies.  These  probabilities  show  for  various 
amounts  cf  time  in  service  the  likelihood  that  the  sailor 
will  be  either  advanced/demoted  to  a  particular  rank,  or 
discharged  from  the  service.  Without  controlling  for  educa- 
tion, Lurie*3  data  (see  Table  III)  show  an  expected  rela- 
tionship between  grade  and  AFQT.  while  the  numbers  are  a 
little  confusing,  it  is  clear  that  as  rank  increases  then 
the  proportion  of  low  AFQT  scores  declines.  However,  what 
is  not  obvious  from  Tabls  III  is  the  combined  effect  of  high 
school  graduation  and  AFQT.  Lurie  found  that  high  school 
graduate  enlistees  with  higher  AFQT  scores,  have  a  better 
chance  of  advancement  to  E3  and  E4 ,  while  the  lower  AFQT 
scorers  have  a  higher  rate  of  attrition.  For  non-high  school 
graduates,      the      probabilities   indicate      that   recruits      with 
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low<rr   AFCT   scores outp«9rforin    those    with   the higher    scor-^g^. 

This  rather  striking  result  cannor  be  attributed  to  differ- 
ential attrition  rates  as  these  are  virtually  identical  for 
both    low      ard  high    AFCT      scorers.      Non-high      school    graduate 

recruits   with  lower    AFQTs   advance   more quickly   to    E4   ar^d    55 

than  do  high  scorers.  On  the  other  hand,  high  scorers  have 
a  much  higher  chance  of  being  reduced  in  rank  than  the  low 
scorers.  Lurie  suggests  that  perhaps  non-high  school  gradu- 
ates with  high  AFQTs  are  dissatisfied  with  their  placement 
as  SHs  believing  they  should  be  better  employed.  However  no 
data  is  presented  to  support  this  notion.  His  overall 
conclusion  is  that  it  appears  feasible  to  set  enlistment 
standards  for  this  rating  based  upon  performance  criteria. 
Unfortunately,  his  recommendations  do  not  suggest  any  new 
standards. 

C.        SDHMABY 

1 .      Theory 

It  is  now  possible  to  give  a  short  summary  of  the 
theoretical  literature  in  this  chapter.  This  is  giv«=n  in 
point    form. 

•  there  are  both  intrinsic  and  extrinsic  pressures  for 
an  organisation  to  be  interested  and  able  to  validate 
its   selection    procedures. 

•  validation  of  selection  standards  can  take  either  the 
'predictive*  or  'concurrent'  research  design  as  they 
produce  equivalent    results. 

•  all  selection  research  should  begin  with  a  thorough 
job  analysis  so  that  relevant  information  is  obtained 
to  assist  in  the  development  of  both  criterion  and 
predictor    concepts. 

•  certain      principles      are      known      which      assist      in   the 
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selection    cf    criterion    and    predictor    measaras. 

•  validity  coefficients  are  susceptible  to  shrinkage 
due  to  a  number  cf  factors  which  may  be  controlled  or 
adjusted    for. 

•  while  correlaticn  coefficients  are  useful  in  selac-ing 
the  mcst  relevant  predictors  frDm  a  large  number  of 
potential  predictcrs  and  as  a  technical  statistic  of 
validity,  alone  they  do  not  indicate  precisely  what 
the   selection    procedures   should    be. 

•  providing  utilities  can  be  estimated  for  the  various 
predictor/criterion  outcomes,  the  decision  centered 
validity  design  appears  the  most  practical  and  useful 
to  determine  predictor  cut-offs  which  maximise  utility 
and  which  ultimately  determine  the  selection  system's 
overall   usefulness. 

•  the  dcuble  cross-validation  design  is  a  means  cf  cver- 
ccming  seme  sources  of  sample  specific  bias  in 
selection    standards  research. 

2 .      Empirical  Results 

From  the      review   cf      previous    studies      the    following 
points   may    be  summarised. 

•  intra-  and  inter-job  differences  (e.g.  complexity)  are 
likely  to  effect  the  relationship  between  predictor 
and   criterion    measures. 

•  validity  coefficients  for  more  complex  jobs  are  likely 
to    ts   higher    than   less   complex    ones. 

•  relationships  between  criterion  and  predictor  vari- 
ables are  not  likely  to  be  stable  over  time  as 
training      and    experience      appear   to      "wash   cut"      these 
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relationships  by  reducing  differences  in  criterion 
performances. 

significant  predictor  measures  found  in  mili-ary  stud- 
ies include  age,  marital  status,  education,  ability 
test    scores  and   cth^r    biographical    variables. 

criterion  measures  used  previously  in  rhe  military 
have  included  the  following  either  singly  or  as  compo- 
sites: length  of  service,  advancement:,  recommendations 
for   re-enlistment   and    various   misconduct   measures. 

seme  recent  studies  (e.g.  Lurie,  1981)  have  emphasised 
the  unusual  moderating  effect  some  variables  may  have 
en   predictors. 
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III.     AIM     AND    PgRPOSE    OF   THIS  ,  RESEARCH 

This  chapter  is  designed  to  make  a  clear  statement  of 
the      aim    and     purpose  of      the   thesis.  Ix   is      a    chance      to 

synthesise  the  literature  survey  of  the  previous  chapter 
into  a  form  which  indicates  the  expected  outcome  from  the 
analysis  cf  the  ratings  chosen  for  s-udy.  The  general 
design  cf  the  research  and  a  statement  of  the  research 
hypotheses   are    also    given. 

a.       PORECSE    OF    RESEARCH 

The  overall  purpose  of  the  present  research  is  to  analy- 
sise  the  available  data  on  a  cohort  of  entrants  to  three  US 
Navy  ratings  in  order  to  test  the  possibility  that  the 
current  selection  procedures  can  be  improved.  The  ratings 
are  Ships'  Serviceman,  Personnelman  and  Aviation  Technician. 
The  study  involves  the  development  of  selection  standards 
which  it  is  hoped  will  snhance  the  total  effective  perfor- 
mance  of   future    entrants   to    these   ratings. 

There      are      several   secondary      purposes.  Inter-rating 

differences  will  be  examined  in  relation  to  the  level  of 
complexity  cf  each  rating.  To  this  end,  ratings  have  been 
chosen  deliberately  with  the  intention  of  having  a  wide 
spread  in  terms  cf  jcb  complexity.  The  research  is  intended 
to  examine  rating  differences  with  respect  to  different 
criteria  cf  performance  both  for  single  and  composite 
measures.  Finally,  it  is  intended  to  apply  the  concepts  of 
utility  analysis  (that  is,  applying  estimates  of  the  cost 
and  the  productivity  of  sailors)  as  a  means  of  de-^.er mining 
the  selection  procedure  which  will  yield  the  maximum  pay-off 
in   terms    cf   total  expected    return   to    the   Navy. 
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B.  AIM 

Tha  aim  of  this  thesis  is  to  investigate  the  possibility 
of  inprcving  the  selection  standards  for  three  US  Navy 
ratings. 

C.  EESIGN 

In  terms  of  the  theoretical  literature,  the  design  of 
the  present  study  is  more  'predictive'  than  it  is  'concur- 
rent'. It  is  not  strictly  'predictive'  in  the  classical 
sense,  as  it  does  not  include  data  on  all  applicants  for  the 
OS  Navy,  but  rather  has  information  on  applicants  who  were 
subsequently  enlisted.  The    research   is      somewhat    'concur- 

rent' in  that  sailors  within  a  rating  are  included  for 
analysis  provided  they  met  at  least  one  of  the  three 
criteria  of    inclusion   discussed   in   a    later    section. 


After      the        selection      of      appropriat 


predictor      and 


criterion  measures,  the  next  feature  of  the  design  is  the 
use  of  double  cross-validation  coefficients  as  an  overall 
gauge  of  the  usefulness  of  the  relationship  between  pred- 
ictors and  criteria  as  a  selection  tool.  This  involves  the 
randcm  splitting  of  the  total  sample  into  two  halves,  devel- 
oping a  linear  regression  relationship  for  each  half,  then 
testing  the  correlation  between  predictions  and  criterion 
measures  in  opposite  halves,  and  averaging  these  correla- 
tions to  get  an  average  validity  coefficient.  In  essence, 
using  the  data  from  one  half  to  predict  the  behaviour  of  the 
ether    half. 

Using  these  linear  regressions  models,  it  is  intended  to 
apply  estimates  of  utility  and  disutility  (i.e.  the  extent 
to  which  a  particular  selection  outcome  gives  a  positive  or 
negative  return  to  the  employer)  in  order  to  establish  the 
optimal  cut-off  value  of  predictions  to  maximise  the  total 
expected    utility.      This   cut-off    value    will    be    expressed   as   a 
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percentage    improvemsn-c  on   the      total    u-ility   obrainatle   when 
■che    predictive    equation   is    not    used. 

The  design  also  includes  an  analysis  of  the  effects  of 
moderaror  variables  (these  are  variables  which  interact  with 
the  predictors).  One  of  the  most  important  in  this  study  is 
job  complexity.  Others  which  have  been  shown  to  be  signifi- 
cant in  other  studies,  and  which  will  be  addressed  in  this 
study,    are    race    and    sex. 

D.       RESEABCH   HYPOTHESES 

While  this  research  in  more  empirical  than  theory  based, 
it  is  possible  to  formulate  at  least  nwo  research  hypotheses 
based   on    past   findings. 

1.       Hypothesis    1 

Age,  educational  level  and  mental  ability/aptitude 
will  be  amongst  the  variables  found  to  be  significant  pred- 
ictors   of   criterion    performances. 

2  •      Hypothesis    2 

Validities  of  the  'predictor/criterion  regression 
equations  will  tend  to  increase  as  the  level  of  complexity 
of   the   Navy   rating    increases. 
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IV.    HETHOD 

This   chapter      describes    the      execution    of  the    research. 

Cn    a    section      by   section    basis    it   deals      with:  the    ratings 

selected,      the    data    base,      the    variables    used,  the   subjects 
chosen   and   zhe    sratistical    analyses    employed. 

A.       NSVI    BATINGS    SELECTED 

As  has  already  been  mentioned,  the  ratings  in  this  study 
are  Ships  Serviceman,  Personnelman  and  Aviation  Technician. 
They  were  chosen  because  they  represent  varying  degrees  of 
job  ccmplexity .  According  to  a  complexity  scale  (see  Sands, 
1979)    these   ratings    have   values   of   : 


a.  Ships   Serviceman 

b.  Perse nnelman 

c.  Aviation    Technician 


no 

67 
95 


The  whole  scale  has  a  range  from  10  -o  99,  with  a  median 
value  of  70,  and  the  most  complex  rating  assigned  a  99. 
These  ratings  therefore  are  representa-ive  of  the  spread  of 
complexity   of  ra'-.ings   in   the   US   Navy. 

Admittedly,  the  ratings  differ  in  terms  of  the  nature  of 
The  wcrk  as  well  as  in  complexity.  This  could  well  be  a 
significant  causs  of  rating  differences  and  may  influence 
the    cutccme    of    the    study.         A    more   ideal    approach    would    have 


been 


select  different   levels  of   complexity  within   -he 


same  type  of  employment.   However,   the  data   did  not  allow 
such  a  fine  classification  of  personnel. 
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Ancther  variable  which  will  obviously  have  an  sffec-  on 
the  outcome  of  -his  study  is  the  fact  thar  for  all  ratings 
an  existing  selection  procedure  is  in  use.  It  requires  that 
entrants  exceed  particular  ASVAB  subtest  scores,  as  well  as 
reaching  a  certain  SCREEN  score.  The  SCREEN  score  is 
explained  in  detail  later,  but  it  is  a  probability  which 
represents  the  chances  of  the  applicant  completing  his 
period  of  service  (Sands,  1979).  The  probability  is  derived 
from  a  consideration  of  race,  AFQT,  marital  status  and  high 
school  diplcma  status.  Such  prescraening  will  tand  to 
restrict  the  range  of  both  predictor  and  criterion  variables 
which    will   have    an    effect   on   validity    coefficients. 

A  general  description  of  each  rating,  which  is  taken 
principally  from  the  US  Navy's  "Enlisted  Career  Guide 
1981-82",    follows. 

''  •      Ships   Serviceman    (SH) 

At  a  primary  level,  depending  upon  their  sp€cialty, 
the  SH  may  work  in  a  barber  shop,  ship's  store,  laundry,  dry 
cleaning  plant  or  office.  Subsequently  thsy  may  assume  more 
responsibility  in  supervisory  and  managerial  roles  associ- 
ated with  retail  stores,  commissary  stores  and  laundry/dry 
cleaning  plants.  Amcng  the  distinguishing  characteristics 
cf  this  particular  rating  is  an  emphasis  on  basic  interper- 
sonal skills.  While  the  actual  employment  may  vary  in  phys- 
ical surroundings  and  requirements,  the  jobs  ail  have  a  lot 
to  do  with  dealing  and  interacting  with  othsr  people.  An 
affinity  for  dealing  with  people  is  therefore  essential. 
Although  there  is  no-*-  a  requirement  for  high  level  cognitive 
skills,  it  is  nonetheless  important  for  SHs  to  be  of  above 
average  ability  in  arithmet  ic  and  in  such  things  as  record- 
keeping and  detail  wcrk.  After  recruit  training,  the  SH 
attends  a  6  weeks'  course  in  the  trade.  There  are  about 
5,000    personnel    amplcyed   in    this    rating   at    present. 
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2  •      gersonnelnian    (PN) 

The  Navy's  pcrscnn slman  is  a  rating  which  special- 
ises in  clerical  and  counselling  duties  with  respect  to 
personnel.  They  provide  information  and  counselling  to 
enlisted  sailors  related  to  Navy  occupationsi.  opportunities 
for  general  education  and  job  training,  promotion  raquire- 
ments,  and  in  rights  and  benefits.  After  recruit  training, 
the  EN  completes  a  6  to  7  week  technical  school.  There  are 
about   7,000    personnel  employed   in   this   rating   at    present. 

3  •      Aviation   Technician (AT) 

The  full  title  of  this  rating  is  Aviation 
Electronics  Technician.  As  the  title  suggests,  sailors  in 
the  rating  are  employed  maintaining  advanced  radio,  radar 
and  elsctronics  equipment  that  are  carried  on  board 
aircraft.  Within  this  broad  area  of  responsibility,  there 
are  three  categories  of  employmsnt.  The  AT  may  be  involved 
in  testing  and  analysis  of  equipment,  its  maintaince  and 
repair,  and  in  related  administrative  tasks.  Aft^r  recruit 
training,  the  AT  attends  up  to  6  months  of  full-time 
schooling,  and  depending  upon  whether  the  AT  is  a  four  or 
six  year  obligator,  he/she  goes  on  to  do  a  farther  6  months 
of  advanced  first  term  avionics.  The  rating  employes  abcut 
10,000   personnel   at    present,   and   there   are    shortages   of    ATs. 

B.       EATA    EASE 

The      cohort      data     base    was      assembled      by     the      Defense 
Manpower   Data  Centre    (DMDC)  for   the   Administrative   Science 

Department  cf  the  Navy  Postgraduate  School  (N?S) .  Cohort 
data  en  some  2  06,000  non-prior  service  sailors  were  obtained 
through  the  merging  cf  three  usually  separate  Navy  files. 
These  files  are  referred  to  as  the  DMDC  file,  the 
Advancement  file,  and  the  Navy  Health  and  Research  Centsr 
(NHRC)     file. 
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The  DKDC  fil°  contains  pre-enlistmant  variables  as  well 
as  en*ry  dates  and  current  sratus.  It  was  assembled  by 
linkir.g  various  copies  of  the  Enlisted  Master  Record  across 
time  using  Social  Security  number.  This  number  was  deleted 
in   the    final  cohort    file   in    -he   interests    of   privacy. 

The  Advancement  file  records  variables  related  tc  the 
promotion  cf  individuals  through  the  advancement  sys-cem.  For 
example,  this  file  provided  values  for  rhe  Final  Multiple,  a 
composite  score,  which  determines  whether  the  sailor  is 
promoted . 

The  IJHRC  file  contains  many  of  the  same  pre-entry  varia- 
bles as  the  DMDC  file,  bur  records  additional  prs-  and 
post-entry  variables.  Amongst  these  are  ap-itude  scores  on 
the  Armed  Services  Vocational  Aptitude  Battery  (ASVAB) 
subtests  and  percentile  scores  on  the  Armed  Forces 
Qualification     Test     (AFQT)  .  The  file      also   contains      such 

things  as  the  total  number  of  absenses  without  leave 
(AWOLs)  ,  demotions,  desertions  and  -he  times  for  promotion 
to   various   grades      (eg  number   of   days    to   E4)  .  NHRC   is   the 

largest   of   the   three    files. 

The  cohort  file  included  data  from  all  enlisted  entrants 
to  the  Navy  between  1  September  1976  and  31  December  1973. 
No  special  data  collect  or  monitoring  of  these  subjects  was 
set  up;  rather  snapshots  of  their  progress  were  taken  in 
September  1982  from  the  various  files  to  create  the  NFS 
cohort   file.  The    time      period   allowed      each   enlistee      the 

cppurtunity  of  serving  about  fcur  years,  with  some  being 
able   to   serve  as   long   as   six   years. 

C.       VARIABLES   IN    THE    EATA   BASE 

There  are  over  260  individual  variables  in  the  cohort 
data  base,  and  -^hose  relevant  for  this  study  are  described 
below . 
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^ •      Criterion  Variables 

Three  critericn  variables  are  used.  One  is  ur.i-ary 
whil6  the  ethers  are  composites.  The  singular  critericn  is 
total  length  of  service  in  months.  This  is  available  on  all 
members  cf  the  cohort  and  is  a  true  Jietric  scale  suitable 
for    regression    analysis.  The   second   criterion    is      a    posi- 

tively  oriented    ordinal   scale.  Three    mutual   exclusive   and 

collectively  exhaustive  categories  of  criterion  outccmes  are 
identified.  Those  individuals  who  did  not  complete  four 
years  of  service  for  other  than  medical,  death  or  officer 
entrance  reasons,  were  grouped  in  the  first  category.  Those 
who  completed  four  years'  service  were  placed  in  the  second 
category.  Those  who  served  four  years  and  were  rated  (i.e. 
became  qualified  in  the  rating),  graded  E4  and  recommended 
for  re-enlistment  were  placed  in  the  third  category.  For 
the  purposes  of  statistical  analyses,  these  three  categories 
were  given  the  values  "10",  "20"  and  "30"  respectively. 
Since  this  scale  attempts  to  differentiate  the  better 
sailors  from  the  others,  it  is  Icnown  as  th3  'goodguy*  scale. 
The  third  criterion  is  negatively  orisnted  and  is  known  as 
the  'badguy'  scale.  The  first  category  includes  those  who 
did  net  complete  four  years  of  service,  who  had  been  disc- 
harged for  negatively  oriented  reasons,  and  had  either 
desertion,  AWOL  or  confinements  recorded  against  them  and 
received      a    value      of   "10".  The     second   ordinal      category 

includes  tho^  who  did  not  complete  four  years  of  service, 
or  those  who  had  demotions  or  were  not  recommended  for 
re-enlistment  regardless  of  their  length  of  service  and  was 
valued  "20".  The  remainder  of  the  group,  who  did  not 
exhibit  any  particularly  negative  behaviours,  were  placed  in 
the    third   category    which   was   valued   "30". 
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while  th9S£  criteria  could  be  defined  in  different 
ways,  they  seem  to  be  consistent  with  the  three  reqairements 
suggested   in  Chapter    II. 

2.  Predictor  Variables 

The  following  potential  predictor  variables  are 
contained   in  the  cohort   file.      They    are: 

a.  age  at  entry; 

b.  marital  staxus; 

c.  highest  education   level   reached; 

d.  number  of    dependents; 

e.  various  ASVAB    subtest    scores    (in   raw   score    form) ; 

f.  AFQT   percentile   scores; 

g.  groupings    based  on   AFQT   scores; 

h.  entry    pay    grade;   and 

i.  SCREEN  score  (which  is  the  probability  of  completing 
the  period  of  enlistment  based  on  education,  AFQT  and 
race)  . 

These  variables  have  all  been  previously  associated  with 
predicting  criterion  measures  in  military  and  non  iiilitary 
settings.  They  are  consistent  with  the  three  requirements 
for    predictors    mentioned   in    the   literature    survey. 

3 .  f^oderator   Variables 

As  was  pointed  out  earlier,  it  is  suspected  that 
complexity  plays  a  moderating  role.  This  has  been  accounted 
for,  partially  at  least,  by  choosing  three  ratings  which 
cover  a  wide  span  of  complexity,  and  for  which  different 
selection    procedures    will   be   developed. 
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Eac€  is  another  variable  which  may  play  a  moderating 
role.  Provided  there  are  no  adverse  impacts  for  mincri'ies, 
as  measured  by  hiring  rates,  it  may  be  possible  to  apply  -he 
same  selection  procedures  across  race,  to  the  rating  as  a 
whole.  Alternatively,  selection  procedures  based  specifi- 
cally on  race  groupings  may  produce  a  better  overall  resul-. 
In  any  case,  previous  research  emphasises  wisdcm  of  taking 
race    into   account. 

Sex  is  another  variable  which  is  believed  -c  play  a 
moderating  role  in  this  research.  In  i:his  study,  there  is  a 
sufficient  number  of  white  females  to  perform  analyses  on 
two    rating   gro'ups    (these   are   PN   and   AT)  . 

**  •      Screening   of    the   Variables 

While  the  accuracy  of  data  en-cries  into  the  original 
three  data  files  is  unknown,  it  is  assumed  to  be  very  high. 
However,  some  cases  were  identified  in  the  cohort  data  set 
which  had  impossible  values.  For  example,  no  entrant  to 
the  Navy  can  be  less  than  17  years  old,  but  some  cohort 
members  were  listed  with  an  entry  age  less  than  17.  These 
cases  were  excluded.  Similarly,  each  of  the  ASVAB  subtests 
has  a  known  maximum  number  of  items,  thus  cases  with  scores 
higher      than      these      limits      were      excluded.  Because      the 

criterion  measures  all  required  that  each  sailor  have  the 
opportunity  of  serving  for  at  least  four  years,  then  those 
sailors  whose  enlistment  dates  precluded  serving  this  period 
were    excluded. 

The  exclusion  of  cases  for  these  reasons  was  'list- 
wise*.  That  is,  the  case  and  all  its  variable  values  was 
deleted.  The    percentage      of      cases      delet-jd   in      this      way 

amounted   to    less   than  5%. 
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5  .      Estimates  of    Utility 

fls  was  argued  in  Chapter  II,  if  a  significant  rsla- 
tionship  tetween  predictors  and  the  criterion  is  found,  -chen 
estimates  of  utility  for  various  selection  ou-coies  become 
important  for  deciding  the  optimum  cut-off  on  -he  predictor 
to  achieve  -he  best  overall  selection  result.  This  involves 
determining  the  cut-off  level  on  the  predictor  for  which 
total  utility  is  maximised  (see  Table  II  and  related  discus- 
sion) .  This  section  discusses  the  derivation  of  the  ^s-.i- 
mates   of   utility. 

To  estimate  the  utility  associated  with  each  of  th^ 
four  possible  selection  outcomes  i-  is  assumed  that  the 
Billet  Cost  Model  (see  Griffin,  1981,  for  an  explanation  of 
the  cost  components  ex  this  model)  provides  reasonable  esti- 
mates. As  is  discussed  by  Campbell  (1976),  it  is  the  inter- 
cell  ratios  which  are  important  rather  than  the  absolute 
values  themselves.  The  Billet  Cost  Model  provides  a  nie-^.hod 
of   approximating   these  ratios. 

For  correctly  predicting  a  successful  sailor,  who 
will  complete  four  y€ars  of  service,  the  total  marginal  cost 
is  taken  as  the  best  estimate  of  utility.  This  is  based  on 
the  assumption  that  the  Navy  compensates  sailors  at  the  full 
value  of  their  marginal  product.  This  is  probably  a  conser- 
vative estimate  as  a  recent  paper  (Butler ,  1982)  has 
suggested.  Butler      has      calculated        for      the      Electronic 

Technician  Rating,  based  on  the  amourxt  of  training  dollars 
the  Navy  spends  on  these  sailors  and  their  expected  total 
service,  th^t  the  Navy  must  expect  a  return  in  product 
considerably  in  excess  of  rating  billet  cost.  Nevertheless, 
the  total  billet  cost  figure  is  accepted  as  the  best  esti- 
mate of  utility  for  this  outcome  (i.e.  correctly  predicting 
success) . 
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An  estimaticn  of  th9  disutility  of  predicting 
success,  when  in  fact  the  sailor  fails  the  criterion,  is 
provided  by  the  rating  cost  estimates  of  3alis  and 
Clay-Mendez  (1982),  Basically  these  data  come  from  the 
Eillet  Cost  Model,  but  include  only  a  few  of  the  elements  of 
the  original  model.  The  Balis  and  Clay-Mendez  cost  amounts 
are  the  average  replacement  costs  by  ratings  across  so 
called  quality  gradings.  The  cost  of  the  replacement  of  the 
highest  quality  grading  is  used  in  the  present  study  as  the 
estimats   of    the    disutility    of    falsely   predicting    success. 

Eelevant  product/cost  figures  are  not  available  for 
the  utilities  associated  with  applicants  who  are  rejected  by 
the  prediction  device.  However,  these  utilities  are  derived 
from    the      above    estimates.  In   the      case    of      the   applicant 

correctly  rejected  (he/she  would  have  failed  on  the 
criterion  measure),  it  is  argued  that  this  selection  outcome 
has  the  same  utility  as  the  disutility  associated  with  the 
entrant  who  fails  the  criterion.  Therefore,  the  'Balis' 
cost  data  is  used  as  the  utility  estimate  for  this  selection 
outcome . 

The  disutility  of  the  rejection  of  the  potentially 
successful  applicant  is  derived  as  follows.  The  disutility 
associated  with  this  outcome  depends  on  the  recruiting 
market  and  whether  it  is  easy  or  difficult  to  get  sailors. 
In  seme  circumstances  it  could  be  that  there  are  so  many 
good  quality  applicants  that  rejecting  potentially 
successful  applicants  has  little  cr  no  disutility.  One 
extreme  value  for  this  utility,  therefore,  could  be  zero.  At 
the  ether  extreme,  the  disutility  of  rejecting  these  appli- 
cants could  be  equal  in  magnitude  to  the  utility  of 
enlisting  a  successful  applicant.  The  estimate  of  the  disu- 
tility of  rejecting  a  potentially  successful  apllicant  is 
taken   as     the  average  of      these   two    extremes.  The    utility 

values,    ty   rating,    are  given    in   Table    IV    . 
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TABLE    IV 
Relative   Utilities  by   Rating 


PREDICTOR    PREDICTOR 

***    SUCCESS     ***  ***    FAILURE    *** 

Criterion   Criterion   Criterion   Criterion 
RATING        Success        Failure        Success        Failure 

SH  19260  -13077  -9630  13077 

EN  18488  -14495  -9244  14495 

AT  22297  -21210  -11149  21210 


The     above      utilities     are   used      to      derive      cut-off 
scores      for        all      three      criteria.  For      the        Length     of 

Service  (LCS)  criterion  they  are  used  directly  as  ths  utili- 
ties for  each  of  the  four  possible  selection  cutconies.  On 
the  goodguy  and  badguy  scales  they  are  used  as  the  basis  of 
developing    utilities   as   described   below. 


TABLE    V 

Relative   Goodgmy   Utilities   by   Rating 


PREDICTOR PREDICTOR 

***    SUCCESS     ***  ***    FAILURE    *** 


C 
30 

riterion 
20              10 

Criterion 
30              20 

10 

SH 

2  8  890 

19260    -  13077 

-19260       -9630 

13077 

EN 

27732 

18488    -  14495 

-18483       -9244 

14495 

AT 

33446 

22297   -21210 

-22297    -11149 

21210 

For  the  goodguy  scale,  there  are  three  criterion 
outccnies,  which  for  the  purposes  of  establishing  a  cut-off, 
gives  a  total  of  six  possible  criterion/predictor  combina- 
tions. The  scale  values  20  and  10  are  taken  to  have  utili- 
ties   as    shown  in   the   above      table.      The    utility    of   correctly 
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predicting  a  goodguy  30  is  computed  to  be  or.3  and  a  half 
times  the  utility  of  correctly  predicting  a  goodguy  20,  As 
was  dene  in  developing  the  above  values,  the  disutility  of 
rejecting  a  sailer  who  would  have  been  a  goodguy  30  is  taken 
as  the  simple  average  of  its  extreme  values.  As  can  be  seen 
in  Table  V,  the  figure  for  SH  is  the  average  of  288S0  and 
9630. 


TABLE    VI 
Relative    Badgay    Utilities    by   Rating 

PEEDICTOB • PREDICTOR 

***    SUCCESS    ***  '^♦^    FAILURE    *** 

Criterion  Criterion 

30  20  10  30  20  10 

SH         19260        13077    -19616       -9630    -13077       16347 

EN         18488       14495    -21743       -9244    -14495       18119 

AT         22297       21210    -31815    -11149    -21210       26513 


Similarly,  the  badguy  utilities,  shown  in  Table  VI, 
were  derived  starting  from  those  in  Table  IV.  These  four 
u-ilities  represent  the  outcomes  for  bad  guy  criterion 
scores  of  20  and  30.  Again,  it  was  figured  that  the  utility 
of  correctly  identifying  and  rejecting  badguy  10s  was  one 
and  a  half  times  the  utility  of  correctly  identifying  a  20. 
As  for  the  goodguy  scale  a  simple  average  gave  the  utility 
for    the    ether   outcome. 

D.        SUBJECTS   CHOSEN 

Withir  the  NFS  cohort  file  there  are  three  possible 
indicators  of  a  sailor's  rating.  These  are  as  follows. 
Firstly,  there  is  a  rating  recorded  at  the  time  of  entry. 
Secondly,      when    the    sailor      attemp-s    the   rating   examination. 
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the  resulting  rating  is  recorded.  Thirdly,  the  DMDC  file 
contains  a  rating  which  is  rhe  sailor's  official  designation 
in  terms  of  rating.  These  rating  variables  are  kno,*n, 
respectively,  as  (1)  entry  rate,  (2)  examination  rate  and 
(3)  DMDC  rate. 

It  wculd  be  an  ideal  situation  if  all  three  rating  vari- 
ables agreed.  However,  there  is  considerable  variation  in 
the  recordings  of  rating  across  these  variables.  In  fact 
there  are  a  total  of  seven  different  combinations  when  it 
comes  to  selecting  suitable  subjects  for  a  particular 
rating.  These  seven  possible  combinations  are  shown  in  the 
Table  VII. 


TABLE  VII  . 
Possibilities  for  Selecting  Subjects  within  a  Rating 


Rat  in 

g   Indi 

catoi 

s                1 

Category         |      Entry 
1 

1 

-X— 

Exam 

DMDC           1 

1 

1 1 

1.                1         Yes 

1 

Yes 

Yes 

2, 

i 

Yes 

1 

1 

Yes 

No 

1 

^        3.           ^ 

Yes 

1 

I 

_,1  ._ 

No 

1 

Yes 

a. 
1 

Yes 

t  - 

1 

■  i.  . 

No 

. 

No           \ 

1 

1 

D  . 

No 

T 
1 

No 

1 

Yes 

6. 

No 

T 

1 
1 

Yes 

Yes  1 
j 

7. 



No 

1" 
i 

No 

Yes         1 

Note  1:  'Yes*  means  that  the  data  file  indicated  that 
the  sailor  was  a  member  of  the  rating  according 
to  the  particular  rating  indicator. 

Note  2:  In  choosing  subjects  who  were  representative 
of  rating  membership,  all  the  above  Categories 
except  #  U.   were   used   as  selection  criteria. 
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'Ih€r€  are  a  numbsr  cf  ways  for  determining  which 
subjects  in  the  listed  categories  are  representative  of  a 
rating.  One  method  could  be  to  select  only  those  subjects 
who  were  coded  in  th=  rating  for  all  three  rating  selection 
variables.  But  this  approach  wculd  seriously  restrict  the 
sample  size  and  , indeed,  it  would  probably  not  produce  a 
repesentative  sample    cf   the    members   of   the   rating. 

Of  the  seven  possible  categories  listed  in  Table  VII,  it 
was  decided  to  initially  select  on  all  seven,  ther.  to 
exclude  these  sailors  in  category  4.  That  is,  the  <=xclu- 
sions  were  those  Navy  entrants  for  whom  the  only  indication 
cf  membership  of  the  raxing  was  their  entry  code.  It  was 
reasoned  than  while  these  sailors  showed  an  interest  in  the 
rating  at  seme  stage  pricr  to  entry,  there  is  no  indication 
that  he/she  had  ever  had  any  work  experience  in  the  rating. 
From  a  concurrent  validity  point  of  view,  it  is  necessary 
for  the  subject  sailers  selected  for  a  rating  to  at  least 
experience  it  and  tc  have  their  rating  performances  influ- 
enced by  that  experience.  Presumably  the  sailors  who  were 
coded  in  th^r  rating  through  rhe  examination  rate  or  through 
a  DMDC  cede  have  had  sufficient  experience  in  -he  rating  tc 
be    considered  representative   cf   the   raxing. 

After  these  variable  screens  were  applied,  and  the 
rating  categories  identified,  subjeczs  were  chosen  within 
each  rating.  These  selections  are  shown  by  race  and  sex  in 
Table  VIII.  As  will  be  seen  in  the  results  section,  it  was 
decided  that  the  numbers  in  some  of  the  race/sex  coiabina- 
tions  were  tco  small  to  perform  realistic  analysis.  There 
are  sufficient  numbers  of  men  in  each  race  grouping.  However 
there  are  enough  white  women  in  only  the  PN  or  AT  ratings  to 
perform  regression  and  other  analyses.  Therefore,  in  all 
subsequent  analyses,  three  groupings  for  SH,  and  four  each, 
fcr    FN   and    AT,    are    reported. 
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TABLE    VIII 
Rating   Selectees    by   Bating,    Race   and  Sex 


FATING      Sex 


SH 
SH 

EN 
EN 


Male 
Female 


Male 
Fe  m  a  le 


i 


AT 

AT 


Male 
Fema  le 


White 


1330 
28 


126  3 

47  9 


« 


Black 


572 

7 


288 
70 


3U00 
24  3 


176 

14 


Others    I       TOTAL 


169 
2 


I  207l' 

I  37 


112 
15 


1663 

564 


114 

3 


3690 
260 


-J 


Note    1:    The    number    of   personnel   ara   shown    in    each    cell. 

E.       STATISTICAL    PROCEBORES 

1 .      G jneral 

New  that  the  criterion,  predictor  and  mcdsra-or 
variatlss  have  been  indicated  and  the  subjacts  identified, 
the      statistical        procedures      will        be      described.  The 

Statistical  Analysis  System  (SAS)  package  (SAS,  1979)  was 
used  for  the  analyses,  along  with  some  FORTRAN  programs 
written      by   the      author.  Sample      programs   are      listed     in 

Appendix   A. 

2 •      C-r script  iye^_  Analyse s 

These  are  giv€n  by  moderator  variables,  and  consist 
of  the  sccr€  and/or  mean  values  on  predictor  and  criterion 
variafclas.  No      statistical      tests    are      applied      to      these 

values,  since  where  significant  differences  occur  these  are 
"captured"    in  the  subsequent   analyses. 
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3  .      Pre  diet  ive    Ar.alvs«rs 

Fcr  «ach  rating  group  the  following  st^ps  are 
appli€d: 

a.  s-€pwise  regression  is  used  to  idenrify  significant 
predictors; 

b.  these  significant  predictors  are  used  in  'crdinary 
least  squares'  regression  to  develop  'double  cross- 
validation'    validity    coefficients;    and 

c.  regression  weigh-s  are  used  to  score  each  case  on  the 
respective  predictor    equations. 

When  the  group  size  was  small,  the  number  of  predictors 
used  in  the  subsequent  stepwise  analysis,  was  limited  to  one 
variable  tc  every  20  personnel.  As  a  consequencer  "^he 
•other'  racial  category  for  ATs  was  limited  to  the  first 
five    variables    selected   in    the   stepwise    procedure. 

^  •      Estimation    of  Cut-offs 

The  'ordinary  least  squares'  regression  equations 
are    used    to    estimate   optimum   cut-offs    as    is    described    below. 

In  crder  to  use  the  utility  values  to  estimate  the 
most  ideal  cut-offs  on  the  predictors,  it  is  first  necessary 
to  consider  the  LOS  criterion  measure  as  a  dichotoaous  vari- 
able. Thus  the  sample  is  divided  into  two  groups;  those 
with  less  than  four  years  and  those  with  four  years  or  more 
of  service.  The  twc  three-point  criterion  scales  were  not 
receded. 

As  is  illustrated  in  the  Appendix  A,  during  the 
double  crcss-validaticn  SAS  run  on  the  computer,  criterion 
measures  predictor  scores  and  the  variable  race  were  output 
to  a  separate  computer  file  which  could  be  accessed  by  the 
FORTRAN    program.         The   predictor    score      output   at    this    stage 
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was  dsrivsd  in  the  following  way:  the  separate  regression 
coefficients,  in  each  of  the  cross-validating  samples,  wer? 
used  to  separately  score  all  the  cases  producing  two  pr=d- 
icted   scores      for   each  case.  A  simple   average      was   taken, 

which  represents  the  predictor  score  output  for  later 
FORTBflN    analysis. 

The  method  for  estimating  the  most  appropriate 
cut-off  score  was  explained  in  Chapter  II.  In  summary,  the 
cutting  score  chosen  is  the  one  which  maximises  equation 
4.1. 


Uc    =    Sum   of    (    Pr(i)    *    at  (i)     )  (eqn    4.1) 

where: 

Uc  is   the   Total    Utility   for    Cutting   Score   c. 

Pr  (i)         is  the   Probability   of    Outcome    (i)  . 

0*  (i)         is  the   Utility    of   Outcome    (i)  . 

The  results  cf  these  analyses  will  be  presented  in 
graphical  form.  In  order  to  get  some  frame  of  reference  for 
evaluating  the  value  of  the  chosen  cut-off  score,  the 
cut-off  is  expressed  as  a  percentage  change  from,  wh^t  is 
known  as  tase  rate.  The  base  rate  is  simply  defined  as  the 
value  of  eqmtion  4.1  when  the  cut-off  is  set  so  lew  that 
every  applicant  is  accepted.  Unfortunately,  base  rate  is  not 
the  true  utility  of  the  current  selection,  since  it  is 
represents  the  assessment  of  the  utility  only  for  those  who 
are  selected  by  these  procedures,  ignoring  applicants  who 
are  rejected  by  them.  As  is  discussed  in  Chapter  VI,  the 
overall  utility  cf  a  selection  device  must  take  into  account 
the    ccsts   involved    in  setting    up   and    maintaining    the    system. 
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Thus,  base  rate,  as  defined  here,  is  a  utility  estimate 
which  ignores  these  external  costs,  buz  i-  provides  an  index 
figure  for  judging  each  potential  cutting  score.  This  index 
for  each  sccre  is  expressed  as  a  percentage  change,  either 
positive   or    negative,   from    base   rats. 
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V.     RESOLTS 

This  chapter  presents  the  thesis  results  and  is  orga- 
nised into  three  sections.  The  first  is  descriptive, 
providing  breakdowns  on  criterion,  predictor  and  moderator 
variables.  The  second  section  derails  -he  predictive 
results.  This  includes  the  variables  selected  for  niultiple 
regression,  and  also  the  results  of  cross  validation.  In 
the  las-  section,  the  results  of  the  applicatiion  of  utili- 
ties   to   estimate   appropriate   cutting    scores,    ire    presented. 

A.       DESCEIPTIYE    RESOLTS 
1  .       S  K^Groufis 

Shewn  in  Table  IX  are  the  means  and/or  frequencies 
by  category  for  potential  predictor  and  criterion  variables 
across  the  three  male  SH  racial  groupings.  It  is  inter- 
esting to  note  that  the  length  of  service  is  greatest  for 
non-whi-e  races.  On  the  other  hand,  both  the  goodguy  and 
tadguy  scales  indicate  that  proportionally  more  of  the  white 
group   have    extreme    values   than   do   the   other   two    races, 

Amorg  the  predictor  variables  there  are  also  some 
interesting  trends.  «hite  personnel  seem  to  be  younger  with 
lower  educational  level.  However,  with  some  exceptions,  the 
whit€  group's  performances  on  the  ASVlVB  subtests  are  better. 
This  finding  is  consistent  with  this  group's  better  AFQT 
scores. 

2 .      EN    Groups 

The  same  basic  trends  noted  for  SH  men  are  evident 
for  EN  men,  as  is  shown  in  Table  X.  The  white  men  are 
slightly      younger,       they      exhibit    'good'       rather    than       'bad' 


60 


TABLE  IX 
Criterion  and  Predictor  Values  for  SH  Men 


Variable 

White 

Black 

Other 

Number    of   Ca£€s 

1330 

572 

169 

Mean  LOS:    months 

44.99 

49.31 

50.82 

30 

24% 

16% 

12% 

Gcodguy    Scale 

20 

33% 

49% 

58% 

J      ^ 

10 

43^ 

35% 

30% 

30 

23% 

17% 

14% 

Eadquy    Scale 

20 

51  fa 

66% 

7  2% 

10 

26% 

17% 

14% 

FBECICTOR    MEANS 

Entry   Age:    years 
Marital    Statijc 

18.7 

19.4 

21.0 

1.3 

1.4 

1.5 

Highest    Education 

11.6 

11.8 

12.  2 

Dependents    (r  umber) 

.03 

.05 

.02 

AFQT  Percentile 

46.6 

34.7 

32.  3 

AEQT  Group 

5.3 

4.5 

4.0 

ELtry  Payarade 
SCREEN    Score 

1.1 

1.2 

1.  1 

80.2 

79.4 

80.2 

ASVA3   Sub-ests: 

Attention   to    Derail 

14.6 

13.8 

12.9 

Numerical  Operation; 

c 

32.  1 

23.  1 

27.3 

Autc.    Information 

10.  1 

7.3 

6.9 

Attentiveness   Scale 

9.7 

10.  8 

Q      Q 

General    Science 

10,4 

8.5 

7.8 

Electronics    Scale 

7.1 

8.3 

8.5 

Math.    Knowledge 

1  1.4 

9.3 

8.9 

Space   Perception 

12.  1 

11.  1 

11.0 

Maintenance    Scale 

9.9 

9.5 

9.6 

Electronic    Info. 

17.9 

15.2 

14.6 

Arithmetic    Reasoning 

g 

12.9 

10-7 

9.5 

General    Information 

9.4 

7.8 

6.5 

Wcrd  Knowledge 
Shop  Information 

19.5 

17.5 

15.  1 

12.7 

9.7 

9.4 

Com  tat    Scale 

- 

15.9 

ia.  1 

13.4 

Mech.   Comorehension 

9.5 

7.4 

6.9 

Note  1:  Gcodguy:  30 


Note  2:  Eadguy: 


20 
10 

30 
20 
10 


served  4  years,  promoted  E4  and 
recommended  for  reenlistment . 
served  4  y=ar3. 
remainder  after  20  and  30. 

remainder  after  10  and  20. 
minor  negative  indicators. 
major  negative  indicators. 


Note  3:  Goodguy  and  Eadguy  percentages  sum  to  100%. 

Note  4:  AFQT  groups:  values  1  to  8,  reoresent  categories 
(in  order)  5,  4C,  4B,  4A,  3b;  3A,  2  and  1. 

Note  5:  Marital  Status:  married  (2)  ;  other  (1)  . 
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TABLE    X 
Criterion  and  Predictor   Values   for   PN   Groups 


MALE 

FEMALE 

Variable 

White 

Black 

Other 

Whi-.9 

Number  Df    Cases 

1263 

288 

112 

479 

Mean   LOS:    months 

48.72 

49.53 

51  .94 

45.67 

30 

17% 

9% 

12% 

21% 

Gocdguy  Scale 

20 

iXQ% 

52% 

63% 

36% 

J       ^ 

10 

35% 

39J 

25% 

43% 

30 

17% 

9% 

14% 

22% 

Badguy  Scale 

20 

72% 

81% 

79% 

74% 

J       * 

10 

11% 

10% 

8% 

4% 

PREDICTOR    MEANS 

Entry    Age:    years 

19.8 

20.7 

21.1 

20.0 

1.4 

1.4 

1.5 

1.5 

Hiahest   Education 

12.  1 

12.2 

12.7 

12.2 

Dependents    (number) 

.07 

.06 

.  03 

.05 

A?CT    Percentile 

63. 0 

49.3 

34.8 

63.9 

AFQT    Group 

6,2 

5.5 

3.9 

6.3 

Entry   Paygrade 
SCREEN  Score 

1.4 

1.5 

1.1 

1.4 

84.3 

82.7 

82.3 

Ncne 

ASVAB    Subtests: 

Attention    to    Detail 

15.0 

14.0 

11  .8 

16.  1 

Numerical    Ooeration 

.s 

35.4 

30.6 

25.6 

37.8 

A  u  t  c .    In  f  o  rm  a  t  i  c  n 

11.3 

8.4 

6.3 

7.6 

Attentiven 9SS    Scale 

11.5 

12.6 

9.0 

12.6 

Ganeral  Science 

12-6 

10.5 

7.8 

11.9 

Electronics   Scale 

7,9 

8.9 

6.9 

5.2 

Math.    Know  led  a  e 

13.7 

11.1 

8.8 

13.8 

Space    Perception 

12.6 

1  1.  1 

9.4 

12.9 

Maintenance   Scale 

9.  1 

9.  1 

7.5 

6.  1 

Elsctrcnic  Infc. 

19.8 

16.7 

13.4 

16.8 

Arithmetic   Reascnin 

.g 

15.0 

12.4 

9.3 

14.3 

General   Information 

10.6 

8.6 

6.2 

8.1 

Wcrd    Knowledge 
ShoD    Information 

23.7 

22.0 

14.7 

24.6 

13.6 

10.7 

8.7 

9.9 

Ccirfcat  Scale 

15.8 

14.6 

11.7 

1U.2 

Mech.    Comprehension 

11,0 

8.  1 

6.7 

9.4 

Notes:    As    for   Taole    IX. 

behaviours,      and  are    better   performers      on    the   ASVAB   and   the 
AFQT    than   are  the   men   in   the   other  racial   groups. 

The  scores  of  the  whi-e  PN  women,  not  surprisingly, 
are  closest  to  the  scores  of  the  white  PN  men.  The  wcmen, 
however,  have  considerably  shorter  average  lengths'  of 
service,      but   exhibit   a   higher      proportion      of    'good'    ra-her 
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TABLE    XI 
Criterion  and   Predictor   Values   for    AT  Groups 


MALE 

FEMALE 

Variable 

White 

Black 

Other 

White 

Number  of    Cases 

3339 

"l72'~" 

109 

242 

Mean   LOS:    months 

53,32 

53.39 

51  .16 

45.37 

30 

18% 

10% 

18% 

14% 

Gccdguy  Scale      20 

52% 

57% 

43;? 

44% 

^                     10 

30% 

33% 

34% 

42% 

30 

19% 

10% 

16% 

15% 

Badguy  Scale         20 

76% 

8  3% 

82% 

76% 

10 

5% 

7% 

2% 

3% 

PREEICTOR    MEANS 

Entry   Age:    years 
Marital  Status 

19.  1 

20.5 

20.2 

20.6 

1.3 

1.4 

1.5 

1.5 

Highest  Educaticn 

12.0 

12.2 

12.2 

12.5 

Dependents    (nutcter) 

.06 

.09 

.08 

.08 

AFQT    Percentile 

72.5 

56.5 

55.6 

79.7 

AFQT    Group 

6.7 

5.9 

5,6 

7.0 

Entry    Paygrade 
SCREEN  Score 

1.9 

1.8 

1  .5 

1  .8 

86.2 

83.6 

83.9 

None 

ASVAE    Subtests: 

ATitenTion    to    Detail 

15.2 

14.5 

15.5 

16.7 

Numerical    Operations 

35.5 

31.4 

33.5 

40.5 

Auto.    Information 

14.7 

10.9 

11.1 

10.0 

Attentiveness    Scal9 

9.4 

10.9 

9.3 

12.4 

General   Science 

14.9 

12.7 

12.5 

14.8 

Electronics   Scale 

1  1.0 

1  1.5 

10.5 

9.1 

Math.    Knowledge 

16.0 

13.9 

14.5 

16.6 

Soace    Percepticn 

14.9 

13.2 

14.0 

15.3 

Maintenance   Scale 

12.0 

10.7 

10.0 

8.7 

Electronic   Info. 

24.  2 

22.0 

21.0 

20.3 

Arithiretic   Heascnina 

16.3 

14.0 

13.8 

16.7 

General  Information' 

1  1.6 

10.  1 

9.1 

9.6 

Word   Knowledge 
Shop    Informaticn 

24.2 

21.5 

19.6 

26.6 

16.2 

12.9 

13.2 

12.  1 

Comrat  Scale 

16.4 

14.6 

14.4 

15.8 

Mech.    Comprehension 

14.5 

10.7 

11  .7 

11.5 

Notes:    As    for   Table    IX. 

•bad'      behaviours.  On      AS7AB   subtests      the      women,        when 

compared  with  white  men,  are  better  on  some  scales  (e.g. 
Numerical  Operations  and  Word  Knowledge),  poorer  on  seme 
ethers  (e.g.  Auto  Information  and  Electronics  Scale)  and 
about  the  same  on  the  remainder.  On  educational  level,  the 
women   have      enrry   educational      levels   which      are    within      the 
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extremes  of  the  rhree  male  racial  catagcries  on  this  vari- 
able. Ir.cidentially ,  it  is  the  male  'other*  race  category 
which   has   the   highest   educational    level    fcr   the    PN    rating. 

3 .      AT   Groups 

For  the  AT  rating  perhaps  the  aost  striking  fact  is 
the  propcrtion  of  ATs  who  are  white  (see  Table  XI,  about 
92%).  This  is     considerably      larger      than   the      equivalsnt 

percentages    for    PN    (    76%   white   )  ,    and   SH    (    6^%   white   )  . 

The  trends  in  the  AT  data  are  consistent  with  these 
already  mentioned  for  FNs  and  SHs.  Again,  the  white  group  is 
younger,  with  lower  education  level  and  generally  better 
AFQT  scores.  However,  for  AT  there  are  proportionally  more 
Blacks  in  the  negative  category  of  the  'bad  guy*  scale  (i.e. 
those  scores  of  '10').  Women  again  have  superior  perfor- 
mances on  seme  ASVAB  scales  and,  for  this  rating,  they  have 
the    highest    education   level. 

B.       PREDICTIVE    RESULTS 

In  this  section  the  results  of  the  stepwise  regressions, 
in  the  form  of  the  variables  selected  and  the  signs  of  the 
respective  coefficients,  are  presented.  These  are  followed 
immediately  by  validity  estimates  fcr  the  predictive  models 
which  are  constructed.  Regression  coefficients  and  statis- 
tics are  net  listed  in  the  body  of  the  thesis:  however, 
interested  readers  are  directed  to  Appendix  B  where  they  are 
given   in   full. 

1 .      Length    of   Service  Criterion 

Fcr  the  SH  rating,  the  variables  selected  as  pred- 
ictors on  the  length  of  service  criterion  by  race,  according 
to  the  sign  of  the  coefficient,  are  shown  on  Table  XII. 
Across   races     all  the     signs   are      consistent    for      predictors 
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TABLE   XII 
Stepwise  Regression   for    SH   on   LOS 


Variable 

White 

Black 

Other 

Entrv    Age:    years 
Mariral   Status 

1 

n 

n 

Pes 

1 

Pos 

Pos 

n 

Highest   Education 
Attention    tc   Detail 

1 

n 

Pos 

n 

n 

n 

Neg 

Auto.    Information 

Neg 

n 

n 

Attentiveness   Scale 

Neg 

Neg 

n 

General   Science 

n 

n 

Pos 

Arithmetic    Reasoning 

n 

n 

Neg 

General   Information 

Neg 

n 

Neg 

Mech.    Comprehension 

n 

n 

Neg 

Comtat    Scale 

n 

Pos 

n 

AFQT  Group 

Neg 

Neg 

n 

Entry    Paygrade 
SCREEN    Score 

Pos 

n 

n 

Pos 

Pos 

n 

Dependents     ^number) 

Neg 

n 

n 

, 

1 « 

Note 

Pes   means 

the 

coetticie 

Neq  means 

the 

coef  f  icie 

•n*    means 

the 

variable 

nt  was  positive, 
nt  was  negative. 
was    not   selected 


which  entered  the  equation  in  more  than  one  racial  grouping. 
Entry  age,  marital  status,  educational  level  and  entry 
paygrade  are  all  positively  ralated  to  length  of  service. 
Longer  service  is  associated  with  higher  values  on  these 
variables.  Nearly  all  the  predictive  ASVAB  subtests,  and 
the  AFQT  groupings,  are  negatively  related  to  length  of 
service. 

As  shown  in  Table  XIII,  there  are  some  differences 
in  the  signs  associated  with  predictors  for  the  PN  groups 
for  the  length  of  service  criterion.  For  whites  and  blacks, 
higher  education  is  associated  with  shorter  service,  while 
for  the  'other'  race  category,  the  reverse  is  true.  There 
are  mixed  signs  for  the  ASVAB  subtests,  but  the  SCREEN  score 
consistently  has  a  positive  sign.  Some  ASVAB  predictors  for 
length  of  service,  in  the  fsmale  group,  have  negative  signs. 
Perhaps  this  is  net  surprising,  because  as  was  noted 
earlier,  women  tended  to  have  shorter  service  but  better 
ASVAE   subtest  scores    than  did    men. 
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TABLE    XIII 
Stepwise   Regression   for    PN   on   LOS 


MALE 


FEMALE 


Variable 

White 

Black 

Other 

White 

r           '                                                       "ill 

!   " 

_    .,  .,,  .  .^ 

Entry    Ags:    years 
Marital  Status 

Pos 

n 

r.      1 

n          1 

Pos 

Pos 

n      ! 

n      1 

Highest  Education 

Neg 

NeQ 

Pos    1 

Neg    1 

Attention    -o    Detail 

n 

n" 

n      1 

Neg    1 

Numerical    Operations 

n 

Neg 

n      1 

^-      1 

Electronics   Scale 

Pos 

n 

n      1 

Pos    j 

Electronic   Infc. 

Pos 

n 

^-      1 

r\            1 

Arithmetic   Reasoning 

Neg 

n 

n       1 

Neg    1 

Word    Knowledge 

Neg 

n 

n      1 

Neg    1 

Ccmtat  Scale 

n 

Neg 

n      1 

n"     1 

Shop    Information 
AFCT    Percentile 

Pes 

n 

n      1 

n      1 

n 

Nea 

n      1 

n      1 

Entry   Paygrade 
j    SCREEN  score 

n 

n " 

n      1 

Pos    1 

Pos 

Pos 

r.      i 

n      1 

Dependents    (number) 

Pos 

Pos 

Neg    1 

1 

c     .                    ...  .,   - _ J 

U     J.. 

( 

Fos 


means  the 
means  the 
means    the 


Note 
cce  ff  icient 
coe  f f icient 
var  iable   was 


was 

was 

no- 


posit 
negat 
.  sele 


ive. 
ive. 
cted, 


TABLE    XIV 
stepwise   Regression   for    AT   on    LOS 


Variable 


White 


MALE 
Black 


Other 


FEMALE 
White 


r    „               ,    —                            — 1 

r              — 1 

1 —         1 

'■^■" 

Entry    Age:    years 
Marital  Status 

n 

n 

Pos 

n 

Pos 

Pos 

n 

Neg 

Highest  Education 

Neg    1 

Neg 

n 

n 

Numerical    Operations 

Neg 

n 

n 

n 

Auto.    Information 

n 

n 

Neg 

n 

Attentiveness    Seal  a      i 

n 

Pos 

n 

n 

General  Science 

Neg 

Neg 

n 

n 

Electronics   Scale 

Pos 

j^ 

n 

Neg 

Math.    Knowledge                ' 

Neg 

n 

■n 

n 

Space   Perception 

Neg 

n 

n 

Tl 

Maintenance' Scale 

n 

n 

Pos 

Pos 

Electronic   Infc. 

n 

n 

Pes 

Pes 

Shoe    Information             i 
AFCi    Percentile               i 

n 

Neg 

T. 

n 

Pos 

n 

u 

n 

AFCT   Group 

Neg 

n 

n 

n 

Entry    Paygrade                  ^ 
SCREEN  Score 

Pos 

n 

n 

n 

Pos 

n 

Pos 

n 

L 1 

1 1 

L     _             _J 

Note 
fricient 
fficient 
'n'    means    the   variable   wa; 


Pos 
Neg 


means 
means 


the 
the 


coe 
coe 


was    positive. 

was    negative. 

i    not   selected. 


66 


Li)c€  the  SHs,  there  is  a  consistency  of  signs  for 
stepwise  entered  predictors  for  the  AT  rating  (see  T^bie 
XIV)  for  length  of  service.  However,  zhe  direction  of  -he 
signs,      for     some   variables,         is   different.  For   example, 

educaticr.al  level  for  two  racial  groupings,  is  now  nega- 
tively r€lated  to  length  of  service.  This  sign  change  is 
carried  ever  into  tha  ASVA3  subtests.  Being  such  a  techni- 
cally ccnplex  rating,  one  would  expect  Science  and 
Mathematics  to  be  positively  related  to  length  of  service. 
However  both  of  these  scales  have  negative  signs. 
Consistent  with  some  of  the  other  stepwise  regressions, 
SCREEN    score  is    positively    related  to    length   of    service. 

2 .      Gcodquy    Criterion 

Table  11  shows  the  variables  selected  by  race  on  the 
goodguy      scale    for      the    SH      rating.         This      is  the      smallest 

TABLE    X7 
Stepwise    Begression   for  SH   on  Goodguy 


"" 

Variable 

White 

Black 

Other 

Marital    Status 

Pos 

Pos 

n 

Highest   Education 
Auto.    Information 

Pos 

n 

n 

n 

Neg 

Electronics    Scale 

Neg 

n 

n 

Math.    Knowledge 

Pos 

n 

n 

Electronic    Info. 

n 

n 

Neg 

Ccmbat    Scale 

n 

Pos 

Pos 

AFQT  Percentile 

n 

n 

Nea 

AFGT  Group 

n 

Neg 

n 

SCREEN    Score 

n 

Pos 

Pos 

— 

L 

i 

_L. 

_. J 

'OS 

n* 


mean 

mean 
mean 


Note 
:he   coefficient    was    positive. 
:h€   coefficient    was    negative, 
;he    variable    was    not   selected. 


number  cf  variables  selected  for  any  of  the  stepwise 
regressions.  The  signs  are  all  consistent  with  the  pred- 
ictor selections  for  SH  on  length  of  service.  However,  it 
is    interesting    to  note  that    AFQT    percentile,    for   the    'other' 
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racial   category,    has    a  negative   sign:    lower   AFQT    percentiles 
ara   predictive    of   better   goodguy   performances. 


TABLE    XVI 
Stepwise    Regression   for  PN   on  Goodguy 


Variable 


MALE 
White      Black 


FEMALE 
Ox  her      Mhi-e 


Marital   Status 

1 

Pos 

~r- 

— r 

n 

n 

n 

- 

Highest   Education 
Attention    to    Detail 

1 

Neg 

Neg 

Pos 

n 

1 

n 

n 

n 

Neg 

Numerical    Operations 

1 

Neg 

n 

n 

Elscticnics   Scale 

1 

Pos 

Neg 

n 

n 

Math.    Knowledge 

n 

Pos 

ii. 

n 

Meet.    Comprehension 

1 

Pos 

n 

n 

n 

Electrcnic   Infc. 

1 

n 

Pos 

n 

n 

Arithmetic   Reasoning 

1 

Neg 

n 

Pos 

Neg 

Wcrd    Knowledge 

1 

Neg 

n      ! 

n 

Neg 

Ccirhat  Scale 

1 

n 

n      1 

Pos 

n 

General   Information 

1 

n 

Pos 

■r\ 

n 

Shcc   Information 
AFCl    Percentile 

1 

n 

Neg    ! 

N  eg 

j^ 

1 

n 

n      1 

N'=g 

n 

SCREEN  Score 

1 

Pos 

n      1 

n 

u 

Dependents    (number) 

1 

Pos 

n 

Neg 

n 

L,                                 ..„,.,                    , 

.± 

..     ..     ..  1 

-. 

Pes 

means 

the 

Neg 
•n* 

m  e  an  s 

the 

means 

the 

Note 
coefricient    was    positive, 
coefficient    was    negative, 
variable    was    not   selected 


As  was  the  case  on  the  length  of  service 
criterion  for  PNs,  the  level  of  education  is  negatively 
related  to  the  goodguy  scale.  This  is  shown  in  Table  XVI. 
ASVAB  subtests  selected  have  varying  signs  and  for  two 
racial  gicucings  for  men,  the  variable  'number  of  depen- 
dents' has  entered  the  regression  equation.  The  SCREEN 
score  for  white  males  is  positively  related  to  desirable 
goodguy    behaviors. 

For  the  AT  groupings,  on  the  goodguy  scale  ,  see 
Table  XVII,  there  is  little  consistency  regarding  which 
variables  are  selected.  Only  three  predictors  were  chosen 
in  acre  than  one  grouping,  and  when  this  happened  th?  signs 
are  different  across  groups.  It  is  interesting  that  for  the 
largest  croup,  white  males,  not  a  single  ASVAB  subtest  is 
selected    as   a  predictor. 
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TABLE    XVII 
Stepwise    degression   for   AT   on   Goodguy 


Variable 


Marital  Status 
Highest  Education 
Atten-^ion    to    Detail 
Attentiveness    Scale 
General  Science 
Electronics  Scale 
Maintenance   Scale 
Electronic   Info. 
Wcrd    Knowledge 
AFCT    Percentile 
AFCT    Group 
Entry   Paygrade 
SCREEN   Score 


■y 


PCS 

means 

the 

Neg 
•n' 

means 

the 

means 

the 

MALE 

FEMALE 

White 

Black 

0-her 

White 

Fos 

1 

n 

n 

n 

Pos 

1 

Neg 

n 

n 

n 

1 

n 

Pos 

r. 

n 

1 

Pos 

n 

n 

n 

Neg 

n 

■p 

n 

j 

n 

n 

Nea 

n 

1 

n 

n 

j 

Pos 

n 

1 

n 

Neg 

1 

Pos 

n 

1 

n 

Pos 

n 

n 

1 

Pos 

Neg 

n 

n 

1 

Neg 

n 

n 

Nea 

1 

n 

n 

n 

n 

! 

T) 

Pos 

n 

J 


J 


L. 


Note 

coefTTcien-  was  positive, 
coefficient  was  negative, 
variable    was    not   selected. 


3.      Eadquy    Criterion 

The    SH    rating,   see    Table    XVIII,    on    this    scale,    shews 
a  consistent     trend    for   education      to    be      oositivelv   related 


TABLE    XVIII 
Stepwise    Regression   for   SH   on    Badguy 


Not- 


Pes 

means 

the 

coerticient    was 

Neg 

»n* 

m  e  an  s 

the 

coefficient    was 

means 

the 

variable    was    no 

positive. 
is  negative, 
lot   selected. 


Variable 

White 

Black 

Other 

Entry    Age:    years 
Marital   Status 

1 

n 

Neg 

n 

Pos 

T" 

n 

Hiqhest   Education 

Pos 

Pos 

Pos 

Numerical    Operations 

Pos 

n 

n 

Auto.    Information 

n 

n 

Neg 

Electronics    Scale 

Nea 

n 

n 

Arithmetic    Reasoning 

n 

Neg 

n 

Combat    Scale 

n 

Pol 

Pos 

Word   Knowledge 

Neg 

n 

n 

AFCT  Percentile 

n 

Neg 

AFCT  Group 

n 

n 

Pos 

Entry    Paygrade 
SCREEN    Score 

Pos 

n 

n 

Pos 

n 

n 

1 

L-                 1 

1 1 

1 1 
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for   all   three  racial   groupings.  Since   zhe    goodgny    and   zh^ 

badguy  scales  are  both  scored  in  the  same  direction  (i.e. 
the  'good*  and  'bad'  ends  have  the  same  numerical  values), 
this  means  that  higher  education  is  associated  with  'ncn- 
bad*  behaviours.  Several  ASVAB  subtests  were  selected,  with 
differing  signs.  Entry  paygrade  and  SCREEN  score  are  both 
positive. 

TABLE   XIX 
Stepwise    Regression   for   PN  on    Badguy 


Variable 

White 

Black: 

Other 

White 

r                                                             1 

1                1 

^ 

Entry    Age:    years 

n 

Neg 

n 

n 

Highest   Education 

n 

n 

Pos 

Pes 

Attention    zo   Detail 

n 

n 

n 

Neg 

Auto.    Information 

n 

Pos 

n 

n 

Space   Perceoticn 
Electronic   Info. 

n 

n 

r 

Pes 

Pos 

1^ 

n 

n 

Arithmetic   Reasoning 

p_ 

n 

n 

Nea 

I    Shcc    Information 
1    AFCi    Percentile 

n 

Neg 

Nea 

n 

n 

n 

Neg 

7^ 

AjtCI   Group 

Neg 

n 

n 

n 

Entry   Paygrade 
SCREEN  Score 

n 

Pos 

n 

n 

Pos 

n 

n 

n 

Dependents    (number) 

Pos 

•" 

Neg           Neg 

Npte 
Pes   means    the   coeffTcien-c    was   positive. 
Neg  means    the   coefficient    was    negative, 
•n*    means    the    variable    was    not    selected. 


For  ENs,  see  Table  XIX,  entry  age  entered 
the  regression  only  for  blacks,  and  it  has  a  negative 
coefficient.  Education  level  is  selected  for  two  groups, 
the  'other'  male  race  category  and  white  women,  and  for 
both,  the  sign  is  positive:  higher  education  level  implies 
fewer  undesirable  behaviours.  There  are  a  variety  of  ASVAB 
subtests  selected  with  differing  signs,  and  it  is  inter- 
esting to  note  that  for  three  of  the  four  groups  the  number 
of      dependents    entered     the    regression.  For   white      males, 

having  mere  dependents  suggest  fewer  negative  behaviours, 
while  for  the  'other*  races  and  white  females,  having  mere 
dependents    is  associated    with   more  negative   behaviours. 
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TABLE  XX 
Stepwise  Regression  for  AT  on  Badguy 


Variable 


MALE  FEMALE 

White      Black      Other      White 


Entry    Age:    years 
Marital  Status 

Pos 

n 

r              — 1 
n 

Pes 

Neg 

n 

n 

Pes 

Highest   Education 
Auto.    Lnfcrmaticn 

Pos 

n 

n 

n 

n 

Pos 

Nag 

n 

Electronics   Scale 

n 

n 

n 

Neg 

Math.    Knowledae 

n 

Neg 

Pes 

n 

Electronic   Infc. 

n 

n 

Neg 

r.      \ 

Arithmetic   Reascning 

n 

Pos 

n 

n 

Ccmcat  Scale 

n 

n 

n 

Pes 

AFCT    Percentile 

n 

Pos 

n 

n 

AFQT   Group 

Neg 

Neg 

n 

Tl 

Entry    Faygrade 

SCREEN  score                       i 

Neg 

Neg 

n 

Nag 

Pos 

n"^ 

Pes 

n 

Dependents    (number) 

n 

n 

n 

Neg 

L 1 _      1 

1 -.. 

L     -     _     -J 

1 ..   J 

Note 
cs  means    the   coefficient    was    positive. 
eg  means    the   coefficient    was   neaative. 
n'    means    the   variable    was    not   selected. 


The  final  stepwise  table.  Table  XX,  show£= 
the  selected  predictors  for  AT  groupings  on  the  badguy 
scale.  The  most  consistent  subtest  finding  across  groupings 
is  the  entry  paygrade,  which  has  a  negative  sign.  This 
variable  is  selected  in  three  groupings  and  implies  that  the 
higher  th?  entry  pay  grade  the  more  likely  are  negative  type 
behaviours. 


^ '      Validity    Estimates 


Shown      in      the      next   series 


tables      are      double 


cross-validition  coefficients  by  rating,  grouping  and 
randomly  selected  sample.  They  are  based  en  forming  prad- 
ictor  equations  frcm  the  stepwise  procedures  for  each 
individual   group.  Validities   for      the   "men      all"    category 

were  the  result  cf  forming  regression  equations  on  all  pred- 
ictors which  had  been  independently  selected  by  male  race 
groupings.  The  average  validities  given  were  calculated 
using  Fisher* s  transformations  for  determining  average 
weigthed  correlation  coefficients  (see  McNemar,  1963,  pp. 
139-1U0)  . 
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a.      Length   of   Service 

The  length  of  service  validities  by  individual 
sample  are  shown  in  Table  XXI.  All  of  nhem  are  significant 
except  fci  the  'other'  male  race  grouping,  in  bozh  the  PN 
and  AT  ratings,  and  the  women  in  the  AT  rating.  Host  of  the 
validities  are  greater  than  .20,  but  only  one  (AT  blacks  in 
Sample    1)    is  in    excess  of   .UO. 


TABLE    XXI 
length   of    Service  Validities  by    Rating   and   Saaple 


1 

Sample 

1 

1 

Sample 

2                 1 

r 

■*                      '            "■            ■          II       !■      ■■     ^P'*' 

*■ 

"x- 

"' 

^■m^                          — ^ 

] 

RATING       j 

n 

T" 

P   < 

n 

r 

P      < 

SH               j 

MEN 

All       1 

1016 

.2748 

.0001 

1022 

.2806 

.0001 

White  1 

671 

.1893 

.0001 

635 

.2330 

.0001 

Black  1 

262 

.3375 

.0001 

2  96 

.2581 

.0001 

ether  1 

91 

.3053 

.0033 

78 

.3640 

,0011 

MEN 

EN               1 
All       1 

817 

.2731 

.0001 

783 

.2785 

.0001 

White  1 

606 

.2881 

.0001 

620 

.2394 

.0001 

Blackl 

158 

.3519 

.0001 

125 

.2963 

.0008 

ether  1 

66 

.0546 

.6634 

46 

.1294 

.3919 

WOMEN    Whitef 

24  1 

.2060 

.0013 

238 

.2939 

.0001 

AT             ! 

MEN 

All       1 

1824 

.2530 

.  0001 

1799 

.2803 

.0001 

White! 

1676 

.2617 

.0001 

1678 

.2856 

.000  1 

Elackj 

91 

.4227 

.0001 

35 

.3338 

.0018 

Other  1 

58 

.2393 

.0705 

^9 

.2125 

.1304 

WCMEN    White! 

124 

.1219 

.  1771 

1  16 

.2399 

.0095 

■ ...  -  ,_  ■ 

1 

-j 

.    -I 

fc.      Goodguy    Criterion 

For  each  rating  as  shewn  in  Table  XXII,  scire  of 
the  validities  by  groups  are  statistically  insignificant. 
The  overall  magnitude  of  these  validities,  compared  to  tbcsr 
for    the      length    of      service    criterion,        are   smaller.  The 

maximum    validity    is       .378,       while   a    number    of      them   are    less 
then    .10. 
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TABLE  XXII 
Gcodguy  Validities  by  Rating  and  Sample 


1 

Sample 

1       1 

Sample 

2       1 

RATING 

n 

r 

P  < 

n 

r 

1 
P  < 

SH 

MEN    All 

10  16 

.1052 

.0008 

1004 

.1373 

.0001 

Whita 

681 

.1586 

.0001 

649 

.2176 

.0001 

Elack 

262 

.1268 

.0403 

296 

.1593 

.0060 

ether 

83 

.3673 

.0006 

73 

.3916 

.0006 

EN 

?^N    All 

817 

.0914 

.0090 

783 

.0666 

-0627 

White 

606 

.1695 

.0001 

620 

.  1464 

.0003 

Elack 

160 

.1579 

.0462 

128 

.1  179 

.1852 

Other 

66 

.0987 

.4306 

46 

.2631 

.0773 

1  WOMEN  White 

241 

.1752 

.0064 

238 

.1799 

.0054 
_._._,. 

AT 

MEN    All 

1824 

.0421 

.0723 

1799 

.0339 

.  1503 

White 

1712 

.0895 

.0002 

1688 

.0303 

.2128 

Black 

91 

.3046 

.0033 

85 

.3503 

.0010 

ether 

58 

.2577 

.0508 

t;o 

.3464 

.0119 

WOMEN  White 

125 

.0004 

.9969 

118 

.0514 

.5807 

C 1 — 

, 

...  _._i 

_..  _  J 

TABLE  XXIII 
Eadguy  Validities  by  Rating  and  Sample 


1 

Sample 

1 

1 

Saaple 

2       ! 

RATING 

n 

r 

P  < 

n 

r- 

P<   i 

SH      1 

1 

MEN    All   1 

1016 

.1713 

.000  1 

1004 

.2062 

.0001  1 

White  1 

671 

.1967 

.000  1 

635 

.2589 

.0001  1 

Elaclcl 

270 

.1178 

.0531 

302 

.1890 

.0010  1 

Other 

91 

.3652 

.0004 



78 

.3254 

.0037  1 

..  1 

PN 

MEN    All 

817 

.0963 

.0059 

783 

.0980 

.0061  1 

White 

606 

.1452 

.0003 

620 

.  1  17a 

.0034  1 

Elack 

160 

.2852 

.0003 

128 

.2049 

.0204  1 

0  -  h  er 

66 

.1102 

.  3784 

46 

.1717 

.2538  1 

WOMEN  White 

24  1 

.1815 

.0047 

238 

.  1896 

.0033  1 

1 

AT 

"T"" 

f 

MEN    All 

1824 

.2293 

.0001 

1799 

.  1999 

.0001 

White 

1676 

.2513 

.0001 

1664 

.2086 

.0001  1 

Black: 

91 

.2741 

.0086 

85 

.3670 

.0006  ! 

Other 

58 

.3728 

.  0040 

52 

.4464 

.0009  1 

WOMEN  White 

125 

.2688 

.0024 

1  18 

.2400 

.0089  I 

-,,,.,       „  1  , 

-J 

,   1  1 

. i 
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c.      Eadguy    Criterion 

For  this  criterion,  validities  seem  to  be  higher 
than  for  the  good  guy  criterion,  as  shown  in  Table  XXIII, 
Only  four  of  the  28  sample  validities  are  insignificant  at 
the  .01  level  of  significance.  The  highest  validity  of  any 
presented  so  far  (.4464)  occurs  for  one  of  the  'other'  race 
samples    (for  ATs) . 

5 .      Average    Validities 

Using  the  Fisher  method,  average  validities  were 
calculated  from  the  validities  just  presented  and  these  are 
shown    in   the  next   two  tables.      Table    XXIV,    shows    the    average 


TABLE    XXI7 
Average  ?alidities    by  Group    and   Criterion 


CRITERION 

RATING       j 

les 

1 —              — 

Goodguy 

Badguy 

■""1 

^  ,,......  .  —  ..     .  ...^.  - .. 

S  H 
MEN         All 

White 
Black 

ether 

.2777 
.2107 
.2959            1 
.3327            ' 

.1212 
.1876 
.1441 
.3787 

.1879            1 
.2272            1 
. 1556            1 
.3470            1 

FN 

MEN         All 

White 
Elaclc 
ether 

WOMEN    White 

.  2757 
.  2888 
.3  277 
.  0852 
.2502 

.0793 
.1578 
.1412 
.1669 
.1775 

.0971 
.  1  312 
.  2500 
.1354 
.  1855 

AT 

MEN         All 

White 
Elaclc 
Other 

WOMEN    White 

.2666 
.2737 
.  3601 
.  2262 
.  1796 

.1380 
.0602 
.3268 
.3002 
.0252 
1 —       J 

.2148 
.2301 
.3197 
.4082 
.2549 

I 

validity  across  each  of  the  samples  by  racial  groupings  and 
ratings.  The  largest  average  validity  occurs  for  the  AT 
rating  (.41)  in  ths  'other'  racial  group  on  the  bad  guy 
criterion.  The  second  highest  validity  is  also  for  an  AT 
rating    (.38);    it   is    for   the    black   racial   group. 
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lable  XXV,  lists  grand  average  validities  for  m-r., 
for  rating  by  criterion.  For  length  of  service,  all  three 
rating  average  validities  are  in  excess  of  .25,  with  a 
slightly      increasing   trend      in      size      of   coefficent      as      the 

TABLE    XXV 
Validities    fcr  Hales   by  Rating  and   Criterion 

CRITERION 


RATING 
SH 


EN 
AT 


ICS 


.  2515 


+— 


.  2707 


.  2762 


Goodgay 


.2046 


.1562 


.0867 


3  a  d  g  u  y  j 

.2277  I 

TT5T7  I 

T245O  ! 


rating  ccmplexity  increases.  For  the  goodguy  seal?,  the 
rank  order  of  validities  by  magnitude  is  reversed:  validi- 
ties decrease  with  rating  complexity.  The  averaae  validity 
for  ATs  on  this  criterion  is  particularly  small.  There  is 
no  consistent  ranking  by  complexity  for  the  other  criterion, 
badguy.  The  PNs  validity  remains  about  the  same  as  for  the 
goodguy  scale,  as  does  the  SH  validity.  The  average  validity 
for  the  ATs  on  this  scale  has  increased  considerably,  up  to 
.245. 

C.       ESTIMATING    COT-OFFS 

The  method  fcr  estimating  the  cut-offs  was  described  in 
the  previous  chapter.  However,  to  illustrate  the  method,  the 
calculation  of  the  first  few  values  in  Figure  5.1  is  given 
here.  It  should  be  noted  that  most  of  the  figures  in  this 
section  have  two  or  mere  graphs  drawn  on  them.  This  is  done 
in  the  interests  of  economy  rarher  than  to  imply  they  are 
related:  each  graph  is  based  on  a  separate  predictor 
criterion    relationship. 
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Figure   5.1        Racs   Blind   Selection    for  sa  on   LOS. 
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The  figures  give  several  pieces  of  information,  tha  most 
important  of  which  is  the  line  repssenting  percentage  change 
from  the  tase  rate,  for  various  potential  predictor  cutting 
scores.  For  Figure  5.1,  the  base  rata  is  determine.^  as 
follows.  Of  the  2,020  male  SH  personnel  1,235  served  four 
years  or  more,  while  785  served  for  less  than  four  years. 
Converting  these  values  to  probabilities  gives  a  61.1U% 
chance  fcr  a  male  SH  meeting  the  criterion  of  completing 
four  years  or  more  years  of  service,  and  38.86%  chance  of 
failing  it.  Using  the  utility  values  given  in  Table  IV  and 
equation  U, 1  we  now  calculate  the  base  rate  as  the  sura  of 
the  products  of  the  chances  of  an  outcome  by  its  utility. 
The  SH  length  of  service  base  rate  is  6,693.39.  As  the 
reader  will  recall,  this  is  the  value  for  selection  set  so 
low  that  all  personnel  are  accepted.  The  first  potential 
cutting  sccre  is  the  smallest  predictor  score  from  the 
sample  of  2020.  This  score  is  34.1208  and  occurs  fcr  an  SH 
who  passed  the  four  year  criterion.  With  the  cutting  score 
set  at  this  value,  there  are  1,234  sailors  out  of  2,020  who 
are  successful  and  who  would  be  correctly  predicted  as 
successful      based      on   this      predictive      relationship.  One 

sailer  cut  of  2,020  would  have  been  predicted  to  have  failed 
the  criterion  for  this  cut-off,  while  785  wculd  have  been 
incorrectly  predicted  to  pass.  The  numbers  are  converted  tc 
probabilities  to  give  61,09^,  .05%  and  38.86%,  respectively. 
These  three  probabilities  have  utility  values  of  19,260, 
-9360  and  -13077.  Summing  across  the  products  of  probabili- 
ties and  utilities  gives  a  total  value  of  6679.23. 
Therefore,  the  return  over  base  rate  for  a  cut-off  at 
34.1208  is  a  -0.21%  change.  There  is  a  slightly  negative 
return  over  base  rate  fcr  this  cutting  score.  Cn  Figure  5.1 
the  values  34.01208  and  -0.21  are  plotted  as  the  first 
cut-cff  pcint  ani  its  respective  return.  The  next  highest 
predictor    score,    34.4115,    is   choosan.    This    happens    to    be    for 
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a  sailer  who  fails  *o  mast  "the  critarion.  At  a  cut-ing 
score  of  3'4.4  115,  the  probabilities  and  their  respective 
utilities  are:  61.09^  and  19,260;  .05%  and  -9360;  .05%  and 
13077;  and,  38.81%  and  -13077,  Summimg  the  product  of  ^hese 
values  gives  a  total  utility  of  6685.70,  which  is  a  -.11% 
decline  ever  base  rate.  Therefore  the  next  point  plotted  is 
34.ai55  and  -.11.  This  process  is  repeated  for  ail  2020 
predictor  scores  keeping  track  of  the  value  of  the  maximum 
return  over  base  rate  and  its  respective  cutting  score. 
Note  in  Figure  5.1  that  values  of  base  rate  return  which  are 
less    than   -20.0%  are    not    plotted. 

Also  shown  in  the  figures  are  two  other  pieces  cf  infcr- 
maticn.  The  selection  ratio  is  defined  as  the  percentage/ 
proporxicn  cf  personnel  selected  our  of  ths  total  who  apply. 
The  values  shown  in  the  figures  are  selection  ratios  at  the 
cutting  score  which  maximise  total  return  over  base  rate.  On 
each  figure  selection  ratio  is  shown  either  by  race  (for 
men)       or      rating    (for   women).  The    other    statistic      is   the 

criterion  proportions  for  those  who  are  predicted  to  be 
successful.  For  Length  of  Service,  the  percentages  who 
serve  for  at  least  four  years  are  given,  while  for  the  ether 
criteria  the  percentages  by  criterion  categories  are  shown. 
This  latter  statistic  gives  an  idea  as  to  the  expected 
performance  of  the  group  selected  for  this  cutting  score, 
while  the  selection  ratio  indicates  how  the  selection  device 
will    impact   the    applicant   group   at  this    score. 

1 .      LOS   Criterion 

As  can  be  seen  from  Figure  5.1,  the  optimum  :;ut-cff 
score  for  the  SH  rating  produces  almost  a  5%  increase  over 
the  base  rate  utility.  The  predictor  equation  here  is  for 
male  SHs  based  en  all  those  variables  selected  for  men  in 
Table  XII.  Th9  Figure  shows  the  selection  ratios  and 
success    percentages    fcr      the   optimum    cut-off   score      by    race. 
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kz  this  cut-cff,  white  SHs  have  the  smallest  selection  ra-cio 
of  any  race,  but  they  also  have  the  smallest  percenzage  of 
success  for  those  who  would  be  selected.  Tne  majority  of  the 
'black'  and  'other'  racial  groups  are  selected  and  the 
highest    percentages    are   successful   in    these   groups. 

Shown  in  Figure  5.2  are  rhe  cutting  scores  derived 
for  race  specific  predictor  equations.  The  bes-  expected 
return  is  fcr  the  'other'  group  (28.8^),  followed  by  whites 
(8.9%),  and  blacks  ( 1 .7%)  .  Set  at  these  respective  cut-off 
levels,  85%  of  the  'ether'  group  are  selected  with  about  767. 
cf  them  serving  beyond  four  years.  For  whites,  95%  would  be 
selected,  with  59%  successful.  For  blacks,  virtually  all 
(99.5??)     would   be   selected,    wirh   a    67%   success   rare. 

In  comparing  these  figures  for  SH  on  LOS  {Figures 
5.1  and  5.2),  several  trends  are  apparent.  The  'race-blind' 
selection  seems  to  be  most  severe,  in  tsras  of  selection 
ratio,  on  the  white  group.  When  the  white  specific  predic-or 
equation  is  employed,  more  whites  are  selected,  for  a  slight 
decline  (about  1.5%)  in  the  percentage  success.  For  the 
black  group,  a  race  specific  predictor  also  improves  the 
selection  ratio,  with  a  slight  decline  in  the  success  rate. 
However  for  the  'other'  race  group,  the  race  specific  pred- 
ictor equation  markedly  reduces  -he  selection  rate  (down  by 
about  13/5),  but  boosts  the  success  percentage  by  almost  the 
same    amount. 

Figures  5.3  and  5.4  show  LOS  results  for  the  PN 
rating.  Race  blind  selection  produces  about  a  6%  improve- 
ment over  base  rate.  As  for  SHs,  the  race  blind  predictor 
is  most  severe  on  the  white  group  in  terms  of  selection 
ratio.  However,  for  those  whites  selected,  their  success 
percentage  is  better  than  the  black  PNs.  While  the  blacks 
are  the  least  successful  for  this  predictor  equation,  about 
97%  cf  them  are  selected.  At  the  cut-off  level  for  this  race 
blind  equation,  100%  of  the  'other'  racial  group  is 
selected,    with    about    76%   of    them   being   successful. 
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Figure  5.2    Hace  Specific  Selection  fcr  SH  en  LOS. 
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Figure   5.3        Race    Blind   Selection    for   ?H  on   LOS. 
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Figure    5.4         Race  Specific  Selection    for   PN    on   LOS. 
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The  return  for  individual  race  selection  equations 
(Figure  5.4)  is  greater  than  from  th^  race  blind  selection 
for  each  race.  Blacks  show  the  biggest  improvement,  with  a 
reduction  in  their  selecticn  rate,  down  from  97^,  but  an 
imprc vemer.t  in  their  success  percentage.  Next  come  whites 
whose  selection  ratio  has  also  been  reduced  but  their 
success  percentage  improved.  This  is  followed  by  the  'other' 
racial  grcup,  who  arc  now  selected  at  a  rate  of  about  94%, 
with  a  slight  increase  in  overall  success  percentage. 
Therefore,  for  all  racial  groups,  race  specific  predictors 
have  lead  to  a  decline  in  selection  rate,  but  improvements 
in   overall    utility   and  success   percentages. 

As  can  be  seen  in  Figures  5.5  and  5.6,  the  same 
trends  are  not  true  for  ATs  on  LOS.  Race  blind  selection, 
lead  to  about  a  3%  improvement  on  base  rate,  with  all  races 
being  fairly  close  together  on  selection  ratios  and  s\icc-=:ss 
percentaces.  The  white  race  is  marginally  ahead  on  both  of 
these  indices.  In  Figure  5.6,  about  the  same  values  apply 
for  whites  en  race  specific  selection.  However,  the  race 
specific  equations  for  blacks  and  for  the  'other'  racial 
group  have  determined  optimum  cutting  scores  for  which  all 
of  the  cases  would  be  rejected.  That  is,  no  one  is  selected 
and    thus   no   one    is    successful.  This   result    may    have      been 

expected  for  A.T  'ethers'  because  of  the  insignificant 
validity  coefficient  fcr  this  group  (see  Table  XXI).  Low 
validity  suggests  that  any  optimum  cut-off  value  is  likely 
to  be  spurious  rather  than  meaningful.  However,  Table  XXI 
shows  a  highly  significant  validity  for  blacks.  Therefore 
deriving  an  optimum  cut-off  which  rejects  everyone  is 
certainly   not  expected. 

Shown  in  Figure  5.7  are  the  LOS  results  fcr  white 
women  FNs  and  ATs.  Eoth  optimum  cut-offs  have  improved  the 
base  rate  figure  (24^  for  PN  and  36%  for  AT)  .  while  the 
selection   ratios   are   lower    than   their    male    counterparts,    so 
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too 


are 


+  V 


i:€ir        success      percentages. 


This      is 


not 


surprising,        since    Tables      X      and  XI      show      women    have      th^ 
smallest    average  LOS   of   all    groups   in    these   ratings. 

2 .      Gccdquy    Criterion 

Shown  in  Figures  5.8  to  5.14,  are  the  results  of  rhe 
analyses   on   this   criterion. 

For  the  SH  rating,  race  blind  selection  leads  to  a 
selection  ratio  for  whites  that  is  the  smallest  of  all  three 
races.  However,  as  can  be  seen  from  Figure  5.8,  the  optimum 
cut-off  yeilds  a  return  of  just  over  2%»  For  race  specific 
selection  (see  Figure  5.9),  the  returns  for  whites  and 
•other'  races  are  well  over  30^,  but  in  this  case,  only  65^? 
of  the  white  group  would  be  selected.  The  selection  ratios 
are  reduced  for  all  races,  compared  with  race  blind 
salecticn. 

The  returns  for  the  PN  rating  en  the  goodguy  scale, 
follcw  a  similar  pattern  as  can  be  seen  from  Figures  5.10 
and  5.11.  However,  for  this  rating,  blacks  in  the  race 
blind  selection,  have  the  smallest  selectioD  ratio,  but  they 
also  show  the  largest  return  (U2%).  Indeed,  race  specific 
selection  has  improved  their  position  in  seiecticn  ratio 
terms  ficm  the  lowest  for  race  blind  selection  to  the  mid- 
point  on   race   specific  selection. 

For  ATs  on  the  goodguy  scale,  race  blind  selection 
does  not  produce  any  positive  return  over  base  rate  (see 
Figure  5.12).  The  return  for  race  specific  selection  (Figure 
5.13),  is  substantial  for  blacks  and  'others'  (38%  and  78%, 
respectively)  but  a  little  more  than  1%  for  whites.  For  the 
•other*  race  group,  this  high  return  is  achieved  with  a 
selection  rate  of  abcut  6  1%.  For  female  PN  and  AT  on  the 
goodguy  criterion,  see  Figure  5.14,  the  returns  are  almost 
600%.  The  cut-off  fcr  AT  seems  unrealistic,  since  only  14% 
are  selected,  whereas  for  PN  the  selection  rate  is  75%  means 
that    a   reasonable   prcpcrtion   will   be    selected. 
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3 .       Eadquy    Criterion 

Th€  seven  Figures  5.15  tc  5.21,  show  -he  results  for 
this    criterion. 

Race  blind  selection  for  aale  SHs,  see  Figure  5.15, 
shows  about  a  3%  improvement  over  base  rate.  White  laer.  are 
the  race  which  have  the  lowest  selection  ratio  in  race  tlind 
selection.  Moderate  improvement  for  whites  and  the  'other* 
racial  group  occur  for  race  specific  prediction  (Figure 
5.16)  . 

For  PN,  see  Figures  5.17  and  5.18,  there  is  virtu- 
ally no  effective  return  using  the  badguy  criterion.  While 
the  'ether'  racial  group  shows  only  about,  a  6%  improvement 
over  base  rate,  the  selection  ratio  of  98.2%  is  ex-remely 
high . 

As  can  be  seen  in  Figures  5.19  and  5.20,  for  AT  aen 
no  selection  device  has  been  found  that  produces  an  improve- 
ment   ever   the   base   rate. 

For  women  on  this  criterion.  Figure  5.21  shows  a 
positive  (AT)  and  a  negative  (?N)  return.  The  AT  return  is 
difficult  tc  interprete  and  results  in  a  99%  selection 
ratio. 
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Figure  5.20    Eacs  Specific  Selecrion  for  AT  on  Badgay. 
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102 


71.  DISCUSSION 

This  chapter  is  divided  into  two  sections.  Th<T  first 
deals  with  the  results  in  relation  t.o  the  research 
hypotheses.      The  second   discasses   other    findings. 

A.       RESEABCH   HYPOTHESES 

The  stepwise  regressions,  particularly  on  the  LOS 
criterion,  tend  to  support  -he  firs-  hypothesis  which  pred- 
icted that  entry  age,  education  level  and  ability  tests 
would  be  significant  predictors  of  performance.  Entry  age 
was  not  selected  for  every  regression,  but  it  proved  to  be 
significant  for  at  least  one  of  the  race/sex  groupings  on 
LOS  for  each  rating.  The  relationship  between  age  and  the 
criterion  was  always  positive:  longer  service  is  indicated 
for      greater  age      at   entry.  Educational      level    was      often 

selected  toe.  Hcwevsr  the  direc-ion  of  the  relationship  was 
net  as  consistent.  For  some  groups  it  was  positive  and  for 
others  negative.  There  seems  to  be  a  trend  for  the  coeffic- 
ient for  education  level  to  be  positive  in  low  complexity 
ratings  and  negative  in  the  higher  complexity  ratings.  This 
finding  cculd  be  a  related  to  restriction  of  range  problems 
which  were  noted  in  the  literature  review.  At  least  seme  of 
the  ASVAE  scores  entered  every  stepwise  regression.  The 
signs    wers    not    consistently    positive    or   negative. 

At  least  for  one  criterion  (i.e.  LOS)  the  validity 
coefficients  when  averaged  across  groups,  show  a  trend  to 
increase  with  job  complexity,  a  relationship  predicted  by 
the  second  hypothesis.  On  the  whole,  the  validity  coeffic- 
ients are  large  enough  to  suggest  that  the  predictor  equa- 
tions     are    sufficiently      powerful     to      improve  selection     on 
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these      three  criteria.  Ccmparing   criteria,         LOS    h^s      the 

highest    validity. 

B.       OTHEB    FINDINGS 

The  descriptive  results  yeilded  several  ger.eral  find- 
ings. They  seem  to  support  -che  view  that  whites  have  supe- 
rior peifcrmances  on  psychometric  -eszs  of  ability.  On  each 
en  the  ASVAB  subtests,  with  one  or  two  exceptions,  the  white 
group  in  each  rating  has  performed  better,  in  terms  of  raw 
score,  means  than  the  other  two  race  groups.  On  the  ether 
hand,  this  race,  for  each  rating,  is  younger  at  entry  and 
(perhaps  therefore)  has  the  lowest  educational  level,  with 
the  smallest  proportion  being  married  variables  which  might 
te  expected  to  be  associated  with  lower  ASVAB  scores.  For 
the  SH  and  PN  ratings,  the  white  group  has  a  shorter  LOS, 
but  with  the  highest  proportions  of  in-service  'gcod'  and 
•bad'  behaviours.  Fcr  the  AT  rating,  blacks  and  whites  have 
about  the  same  LOS  (blacks  serve  slightly  longer) ,  and 
whites  are  more  likely  to  have  positive  goodguy  perfor- 
mances. The  white  women  have  similar  performances  as  white 
men  on  both  the  predictor  and  criterion  variables,  except 
that  they  have  the  shortest  LOS  and  generally  exhibit  the 
smallest   percentage    cf    'bad*    behaviours. 

The  estimation  cf  cut-offs,  for  all  criteria,  has 
supported  the  notion  that  the  significant  relationship 
between  predictors  and  criteria  can  be  useful  in  a  selection 
satting.  As  measured  against  the  concept  of  base  rate,  many 
groupings   within  ratings   can   be    better   selected. 

The  findings  of  this  reseach  support  the  current  US  Navy 
selection  procedures.  For  every  stepwise  regression  in  which 
it  was  selected,  the  SCREEN  score  (which  is  derived  directly 
from  the  current  procedures)  was  always  positively  related 
to    the   criterion. 
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From  the  averaged  validities  it  appeared  that:  the  LOS 
predictors  provide  a  means  of  increasing  the  selection 
utility  across  most  trade,  race  and  sex  groupings.  However, 
when  optimum  cut-offs  were  derived  it  was  apparent  that 
virtually  none  of  the  AT  relationships  would  yield  any 
reasonable  utility  improvement  over  the  base  rate.  For  the 
ether  ratings  it  appears  that,  except  for  SH  blacks,  there 
are  positive  returns  to  be  obtained  through  selection  based 
on  the  identified  predictcr/crirerion  relationships.  The 
highest    returns    are      for   ?N    and   AT   women.  This    is   despite 

the  fact  that  some  predictor  equations  had  validities  which 
were  small,  and  in  some  cases  statistically  insignificant 
(e.g.  FN  'ether'  and  AT  women).  Apparently,  although  the 
validity  coefficient  was  insignificant  the  rela-^ionship  was 
still  strong  enough  to  yeild  a  cutting  score  which  improved 
overall    utility. 

The  ether  two  criteria,  although  they  did  not  have 
double  cross-validit ion  coefficients  which  were  as  large  as 
for  LCS  across  groupings  of  personnel,  also  apparently  are 
predictable  from  pre-entry  information.  However,  when  the 
cut-offs  were  determined,  the  goodguy  criterion  appeared  to 
have  potential  for  improving  selection  in  all  groupings, 
withthe  exception  of  AT  white  women.  For  only  three  group- 
ings on  the  badguy  criterion  was  a  cut-off  found  which 
returned  tetter  than  5%  over  base  rate.  In  a  real  sense 
these  seem  more  useful  criteria  than  LOS,  since  they  appear 
to  capture  more  relevant  information  relating  product  and/or 
cost.  The  extent  that  personnel  are  promoted  during  a  period 
of  service  and  the  extent  to  which  costly  negative  behav- 
iours can  be  avoid  are  significant  contributers  to  the  orga- 
nisations overall  effectiveness.  It  would  appear  that  th^^ 
decision  centered  validity  approach  has  revealed  a  number  of 
potentially  useful  relationships  which  may  be  used  for 
better    selection. 
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Th€  rac9  blind  selecticn  cut-offs  provided  scm<T  ir.-sr- 
estir.g  findings.  For  the  SH  rating  in  particular  it  seems 
clear  that  the  white  race  would  have  greater  propcrticns 
rejected  than  the  other  two  racial  groups  if  the  race-tlind 
prediction  device  was  used.  However,  as  has  already  been 
menticned,  mere  of  the  white  SH  personnel  should  be  rejected 
since  they  exhibit  poorer  criterion  performances  than  the 
'other'  races.  For  the  PN  rating,  race  blind  selection  also 
selects  the  smallest  percentage  of  whires.  This  is  a  mere 
curious  result  since  for  both  ratings,  most  of  the  personnel 
were  white  and  one  wculd  expect  that  they  would  dominate  the 
regressions  to  the  extent  t hax  greater  proportions  of  whites 
would   be      selected    than      would   the      other    races.  For   race 

specific  selection  the  white  selection  ratio  at  the  optimum 
cut-off  is  no  longer  the  lowest  for  the  LOS,  but  it  is  for 
the  goodguy  scale.  It  appears  that  whites  do  not  perform  as 
well    as   the    other   races   in    these   ratings    (PN   and    SH) . 

The  decision  centered  validity  approach  has  turned  cut 
to  be  a  powerful  tool  for  the  present  research.  It  has 
allowed  a  means  of  directly  demonstrating  the  usefulness  of 
a  composite  predictor  in  a  future  selection  role.  Provided 
appropriate  utility  values  can  be  derived,  it  is  obvious 
that  the  methodology  employed  in  this  study  could  be  broa- 
dened. For  example,  in  evaluating  which  cut-off  to  apply, 
the  criterion  can  be  segmented  into  as  many  separate  catego- 
ries as  is  required  to  reflect  the  different  individual 
returns  for  the  pairs  of  predictor  outcomes.  At  one  extreme 
in  criterion  categorisation  is  the  LOS  methodology  employed 
here,  in  which  the  criterion  was  considered  as  a  dichotomy. 
At  the  other  is  the  situation  in  which  each  and  every 
subject  in  the  research  could  be  individually  evaluated  in 
utility  terms.  For  example,  for  every  subject  a  value  could 
be  placed  on  the  service  he/she  provided,  and  an  estimation 
could    be    made      as    to      the      value      to      the      Navy    (positive    or 
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negative)  in  tha  case  that  this  parson  was  not  enlisted 
bacause  of  selection  screening.  These  two  values,  which 
would  prcbatly  not  be  tha  same,  could  be  taken  as  predictor 
accept  and  predictor  reject  utilities  and  then  used  in 
exactly  the  same  manner  as  in  this  study  to  determine  an 
optimum  predictor  cutting-score  which  maximises  total 
utility  for  all  subjects.  If  the  utility  values  were  accu- 
rately derived  from  costs  and  products,  then  it  may  be 
possible  tc  express  selection  utility  in  dollars  per 
enlistee,  which  would  be  a  readily  acceptable  tneans  of  just- 
ifying  a   selection    procedure. 

In  applying  the  regression  equations  developed  here  to 
an  actual  setting,  there  are  two  other  important  considera- 
tions. These  are  both  related  to  decisions  that  the  Navy 
would  make  with  respect  to  implementation.  In  this  thesis, 
there  was  no  external  Navy  decision  as  to  which  criteria  of 
performance  is  the  most  useful  for  perscnnel  selection. 
Length  of  service  is  widely  used  as  a  measure  of  good/ 
desirable  behaviour,  but  for  soma  employments,  it  may  not  be 
so  important.  Indeed  for  some  employments,  "short"  tenure 
may  even  be  a  goal  (e.g.  those  employments  which  serve 
primarily  tc  prepara  personnel  for  later  jobs).  So  before 
any  attempt  is  made  tc  implement  these  results  the  criterion 
would  need,  to  be  specifically  defined.  It  could  be  that 
there  ars  ether  more  pertinent  criteria  than  those  employed 
in    this   thesis. 

The  other  issue  about  implementation  is  related  to  costs 
and  has  two  aspects.  First,  tha  present  study  estimated 
costs  and  utilities  through  published  cost  data.  These 
figures  were  clearly  and  directly  relevant  for  *he  LOS 
criterion,  but  even  in  this  application  assumptions  were 
made  as  to  the  relative  value  of  the  predictor/criterion 
outcomes.  There  are,  perhaps,  better  accounting  or  economic 
procedures   to  estimate  these   values      than    was   used   here.      An 
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€valuaticr.  cf  tii=  utilitias  employad  here  is  nesd^d  b€fcr  = 
implementaticn  of  these  selection  devices.  Second,  the  c-her 
aspect  cf  cost  is  directly  related  to  impiementaticn .  In 
determining  the  optirnum  cutting-score  on  the  predictive 
device  fcr  this  study  and  expressing  this  as  a  percentage 
return  over  base  rate,  it  is  clear  that  it.  does  not  take 
into  account  any  costs  associated  with  implementation.  A 
ccst-tenefit  type  of  analysis  would  be  necessary  to  weight 
up  the  total  costs  of  implementing  and  maintaining  the 
procedures,  against  the  expected  return  in  terms  of  more 
profitable  selection.  The  data  presented  here  are  relevant 
to  this  type  of  analysis,  but  returns  over  base  rate,  for 
example,  would  need  to  directly  take  account  of  the  numbers 
upon  which  each  of  the  graphs  in  the  previous  chapter  was 
based  on.  Some  of  the  very  high  returns  over  base  rate  may 
be  seen  in  a  different  light  when  the  numbers  of  cases  is 
taken  into  account.  Ease  ra-^.e  is  a  utility  per  enlistee:  if 
the  applicant  pool  is  small  ,  total  utility  (the  product  of 
the  number  of  enlistees  by  utility  per  enlistee)  might  not 
be  so  high.  If  the  cost  of  implementing  and  maintaining  a 
procedure  was  very  high,  then  the  expected  return  over  base 
rate  would  have  to  be  even  higher,  so  as  to  produce  a  posi- 
tive   return. 
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VII.     SnMWARY    AND    CONCLOSION 

This  thesis  set  out  to  develop  selection  standards  for 
three  US  Navy  ratings  which  varied  in  zerms  cf  their 
complexity      requirements.  The      selection      literature      was 

extensively  reviewed.  This  gave  direction  as  to  the  varia- 
bles likely  to  be  predictive  cf  subsequent  performance  as 
well  as  seme  guidlines  for  choosing  appropriat-?  criteria  t.o 
predict.  The  method  of  evaluating  the  predictors  in  fore- 
casting subsequent  performances  took  two  forms.  The  first 
was  the  Traditional  method  for  estimating  validity  coeffic- 
ients through  double  cross-validation.  The  second  applied 
utility  esx-imates  xo  various  predictor/criterion  outcomes  so 
as  to  determine  the  cut-off  score  on  the  composite  predictor 
which  maximised  overall  utility.  These  analyses  were  dene 
controlling  for  the  effects  cf  such  moderator  variables  as 
job    complexity,    race   and   sex. 

Within  each  rating  a  number  of  useful  preiiczor/ 
critericr  relationships  have  been  found.  These  relationships 
were  shown  to  be  valid  and  cuxting  scores  derived  which 
maximisrd  total  u-ility  of  the  selection  device.  Scrae 
results  suggest  a  significant  race  component  in  performance. 
This  finding  suggests  the  white  race  does  not  perform  as 
well  as  the  ether  races  in  the  SH  and  PN  rating.  The  signs 
on  scire  ASVAB  coefficients  indicate  negative  relationships 
with    criterion    scores.   This    result   was   not    expected. 

This  research  has  illustrated  the  relationships  that 
exists  in  the  data  and  the  use  to  which  they  could  b=  put 
for      selection    purposes.  Implementation    of      any   cf      these 

relationships  as  a  selection  tool  requires  a  confirmation 
that  the  criteria  used  here  are  relevant  and  useful  to 
personnel   managers    in   the   US   Navy.      In   addition,    the   current 
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analysis  has  been  performed  without  any  consideration  of  -he 
possible  costs  of  the  introduction  and  maintenance  of  the 
selection    procedure.  It    would    be      necessary   to      conduct   a 

cost  benefit  analysis  -co  determine  if  the  total  expected 
returns  froir,  implementation  were  sufficient  to  compensate 
for  the  costs  involved  and  therefore  to  produce  a  positive 
total  return.  To  do  this  properly  requires  Navy  decisions 
about  the  appropriateness  of  the  criteria  to  be  predicted 
and  the  utility  and  disutility  values  to  be  assigned  to 
correct  and  incorrect  predictor/criteria  classif ica-ions. 
Such  a  cos-  benefit  analysis  has  not  been  attempted  here, 
but    is  relevant    for    future    research. 
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APPENDIX, .A 
EXAMPLE   PROGRAH    LISTINGS    BASED    ON    PROCESSING    SH 

This  appendix  gives  sample  listings  for  the  prograns 
used  to  analysis©  the  SH  rating.  These  exactly  parallel 
analyses    for  the  other  ratings. 

"I  •      SAS    Program    to   Select    SH    from    NFS    Cohort    Data 

Cn  the  following  pages  (Table  XXVI)  is  a  listing  of 
the  SAS  job  to  select  out  the  SH  from  the  Cohort  File  of 
206,000    and   to    place   their    records  on    flass    Storage. 

The  variables  are  read  in  from  raw  data  and  the 
first  two  pages  of  Table  XXVI,  show  the  variables  locations 
and  their  descriptions.  This  lists  all  the  variables  avai- 
lable in  the  cohort  even  though  only  a  smaal  number  of  them 
were    actually  used    for  the    present   analysis. 

The  reader  is  referred  to  the  SAS  "Us^^r's  Guide"  for 
an      explanation      of      the        procedures      involved.  Comments 

throughout    the    listing  explain    some   of   the    program    steps. 

2  •      SAS    Program  .to   Perform   Regressions 

The  following  two  tables  give  lis-ings  for  two  SAS 
programs. 

The  first  (Table  XXVII)  is  the  one  used  perform 
stepwise  regression  cn  the  whole  set  of  predictors  so  as  to 
select  cut  those  which  the  more  useful.  The  reader  will  note 
that  after  the  SH  data  is  read  in,  it  is  sorted  by  race 
which  facilitates  the  subsequent  regressions  which  are 
performed   by  race. 

The  second  (Table  XXVIII)  uses  the  output  from  the 
previous  analyses  to  construct  regression  models  for  rele- 
vant     race/sex    groupings.         The      data      is    split,         for      each 
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grouping,  into  two  random  samples  assd  as  the  basis  for 
cross-validation.  Predictor  and  criterion  scores,  aft.er 
validation  are  then  output,  in  raw  dara  form,  to  mass 
storage  so  as  to  be  available  for  later  FORTRAN  analysis  in 
estimating   cut-offs. 

3  .      FCRTRAN Program us^l ^ Estimate Cut-offs on 

Predictors 

Ihe  raw  output  produced  in  the  preceding  SAS  run  is 
used  as  input  data  for  this  program  (Table  XXIX)  alcng  with 
the    appropriate    utility   values. 

The  program  is  written  so  as  to  be  run  on  one  of  the 
Navy  Postgraduate  School's  rerminals  which  is  linked  to  a 
Tecktrcnics  plotter,  although  it  could  easily  be  rewritten 
for  a  different  plotting  device.  The  plotting  is  performed 
using   subroutines  of   the   School's   DISSPLA    computer    package. 
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TABLE    XXVI 
Listing    of   sas  Set-Op   Program:    Cohort   to   File 

//NESBITTS    JOE     (250  1  ,  01  71)  , '  NESBITT     ',CLASS  =  K 

//♦MAIN    ORG=NFGVM1.2501P 

//    EXEC    PGM  =  IZFBR14 

//DD1    DD    DISP=  (OLD, DELETE)  ,DSN  =  flSS.  S2501.NRATESH 

//       EXEC    SAS 

//SAS. WORK    DD    SPACE=  (CYL  ,  ( 10  ,  1  0)  )_, 

//  CISP= (NEW, DELETE, DELSTE) , 

//      VOL  =  SSR=  (MVS0  07, MVSO 1 2 ,MVS 03 9, MVSO 04)  ,UNIT=3  35  0 

//FILEIN    DD       UNIT=3400-5-VOL=SER=ENLIST, 

//       DISP=OLD,DSN=ENLST. ALL.A7678 

//FILEOUT    DD    UNIT=33  30  V,  MSVGP  =  PUB(*B  , 

//         DISP=(NEW,CATLG) ,DSN=MSS . S250 1 .NRATESH, 

//         DCB=  (BLKSI2E=64  00) 

//SYSIN    DD    * 

CETICNS    ERR0RS  =  5; 

DATA    FILEOUT.  NEATESH  ; 

INFILE    FILEIN;     INPUT 

0)    16    ENTRYAGE    FIBI.     3    17    RECORDID  PIBI. 

ol    18    HYEC  PIBI.     0)    19    SEX  PIBI. 

3    20    RACE  riBI.     a!    23    mRTLDPND  PIBI. 

a    24    TESTFORM    PIBI.     a)    25    AFQTPCNT  PIBI. 

a    26    AFQTGRPS    PIBI.     a)    27    ASVABGI  PIBI, 

3    28    ASVABNO       EIBI.     3    29    ASVA3AD  PIBI. 

a    30    ASVABWK       PIBI.     3    31    ASVABAR  PIBI. 

3    32    ASVABSP       PIBI.     3    33    ASYABMK  PIBI. 

3    34    ASVAEEI       PIBI.     3    35    ASVABMC  PIBI. 

3    36    ASVABGS       PIBI.     3    37    ASVAB3I  PIBI. 

3    38    ASVABAI       PIBI.     3    39    SERVACCS  PIBI. 

a    40    PRIORSRV    PIBI.     a    43    ASVABCtM  PIBI. 

3    44    ASVABCA       FIBI.     3    45    ASVABCE  PIBI. 

3    46    ASVABCC       PIBI.     3    58    ENTRYYR  PIBI. 

3    61    TERMENLT    PIBI.     3    62    ENTSPAYG  PIBI. 

3    59    ENTRYMTH    PIBI.     3    60    ENTRYDAY  PIBI. 

3    65    PROGENLT    PIB5.     3    73    BONUSOPT  PIBI. 

3    74    ENLSTOPT    PIBI.     3    75    YOUTHPRG  PIBI. 

3    78    TAPEDATE    PIBI.     3    81    TRENLMOS  PIB5. 

a    86    TAF?1S1  PI32.     3    88    DP0C1  PIB2. 

3    90    DD0C1  FI32.     3    92    HYECI  PIBI. 

3    93    PAYGRDE1     FIBI.     3    94    SERYTCS1  PIBI. 

3    95    MRTSIAT1     FIBI.     3    96    NDPNDNT1  PIBI. 

a    97    SPNSPD1        FIB3.     3100    ISC1  PIBI. 

3101    SEPRT1YR    PIBI.     3102    SSPRT1MT  PIBI. 

3103    SEPRT1DY    FIBI.     3104    BASDIYR  PIBI. 

3105    BA3D1MTH    PI31.     3106    BASDIDAY  PIBI. 

3107    ETS1YEAR    FIBI.     3108    ETSltlNTH  PIBI. 

31C9    D0LE1YR       PIBI.     3110    DOLEIMTH  PIBI. 

3113    FEBD1YR       PIBI.     3114    PEBD1MTH  PIBI. 

3115    PE3D1DAY    PIBI.     3111    CHARSRV1  PIBI. 

3112    ELGREUP1    PIBI.     3116    FILEFLGI  PI32. 

3118    TAFMS2  FIB2.     3120    DP0C2  PIB2. 

3122    DD0C2  PIB2.     3124    HYSC2  PIBI. 

3125    FAYGRDE2    PIBI.     3126    SER7ICE2  PIBI. 

3127    MRTSTAT2    FIBI.     3128    NDPNDNT2  PIBI. 

3129    SPNSFD2       PIB3.     3132    ISC2  PI31. 

3133    SEPRT2YR    FIBI.     3134    SEPRT2MT  PI31. 

2135    SEPRT2DY    PIBI.     3136    3ASD2YR  PIBI. 

3137    BASD2MTH    PIBI.     3138    BASD2DAY  PIBI. 

3139    ETS2YEAR    FIBI.     3140    ETS2MNTH  PIBI. 

3141    D0LE2YR       PIBI.     3142    0OLE2J1TH  PIBI. 

3145    PEBD2YR       FI31.     3146    PE3D2MTH  PI31. 

3147    PEBD2DAY    FIBI.     3143    CHARSRV2  PIBI. 

3144    ELGREUP2    FIBI.     3143    FILEFLG2  PIB2. 

3150    TAFMS3  PIBI.     3151    TAFMS4  PIB1  , 

3152    DP0C3  PIB2.     3154    DD0C3  PI32. 
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3)156  HYEC3  FIB1.     a)157  PAYGRD33    PIE1. 

ai58  SERVICES    FIBI.     51159  MRTSTAT3    PIB1. 

0)160  NDPNCNT3    PIB1.     5)161  SPNSPD3       PIB3. 

0)165  SEPRT3YH    PIB1.     5)166  SEPRT3MT    PIB1  . 

5)167  SEPRT3DY    PIB1.     5)168  BASD3YR       PIB1. 

5)169  BASD3MTH    FIBI.     3)170  BASD3DAY    PIB1  . 

ai71  ETS3YEAR    FI31.     5)172  EIS3MNTH    PIB1. 

5)173  D0LE3YR       FIBI.     5)174  D0LE3HTH    PIBI. 

0)177  PEBD3YR       PI31.     2178  PEED3MTH    PIBI. 

5)179  PEBD3DAY    FIBI.     5)164  ISC3  PIBI. 

5)175  CHARSRV3    FIB1.     5)176  ELGREUP3    PIBI. 

5)180  FILEFLG3    FIB2.     5)182  FILEMTCH    PI34. 

5)ie6  DOEYRDEP    PIBI.     5)187  DOEMTDEP    PIBI. 

5)188  MNTHSDEP    PIBI.     3189  SPFLGML       PIBI. 

5)190  DCPGYR  PIBI.     5)191  DCPGMNTH    PIBI. 

5)212  GCT       2.     51214    AR I    2.  5)216    MSCH         2. 

3218  CLER    2.     5220    AF QTS    2.     3222    PNEC    $4. 

5)227  CTZNSHIP         $1.     5)229  PRIDEPND         $1. 

5)230  SECDEPND         $1.     5)23  1  3HCL  52. 

5)233  GROUPIND         $1.     3234  AUTHRATE  34. 

3240  EDPGYR  $4.     3244  SCHLCODS         $1. 

3245  SCHLWVR  Si.     3246  ASTAF  SI. 

3247  TSSIND  SI.     3250  PRESRATE         54. 

3254  N0MPG1  SI.     3255  PRRTA3R7         $3. 

3258  EXAMRATE         14.     3262  NUMPG2  S1 . 

3263  EXRTABRV         S3.     3266  TOTLEAW  3. 

3269  STDNAVY  2.     3272  PRCODE  ."^2. 

3274  ALTPRCDE         $2.     3276  FINLMULT  5. 

3281  FNMLTCDT  5.     3287  PRFFACTR  3. 

3290  AWIFACTR  2.     3292  CHNGRATE         $1. 

3296  RATEIND  $1.     3297  SPPROIND         SI. 

3298  TYPENLST         $2.     3301  MODEST  Si. 

3302  NENLSTMT  1.     3303  EAOS       YYMMDD6. 

3309  TAS  S4.     3313  OAS  $4. 

3317  LOSCODE  SI.     3318  LOSWVR  SI. 

3319  SIPG  S4.     3323  TIRWVR  SI. 

3324  TIR  $4.     3336  ADBD       YYMMDD6. 

3343  EDPG      YYMMDD6.     3349  DTIS  3. 

3352  RECFORES  1.     3356  NCHANGSS  3. 

3384  AGE  2.     3386  NHRCGCT  2. 

3388  NHRCAFQT  2.     3390  MENTLGR?         SI. 

3391  EDCERTIF         $1.     3392  MOBLDSGN         Si. 

3394  HYNDPNDT  2.     3396  GRP4PR0G         $2. 

3398  SSDOTY  SI.     3399  REGRESRV  SI. 

3400  HYPAYGRD         SI.     3401  NOTRCMD  SI. 

3402  SSNCHNGE         SI.     3403  TOTPROMO  2. 

3405  TOTLDEMO  1.     3406  TOTLAWOL  1. 

3407  TOTDESRT  1.     3408  TCTMLTCN  1. 

3409  TOTCVLCN  1.     3412  LNGTHSRV         S4  . 

3416  SCREEN  2.     3418  ATTRITCD  SI. 

3419  RECNTC  Si.     3420  RECSNLST         S2. 

3422  RECPROGM         SI.     3423  RECPRGSC         S2 . 

3425  PCPGSCRT         S4.     3435  ELSTHIST         $1. 

3436  NDAY3E2  4.     3440  NDAYSE3  4. 

3444  NDAYSE4  4.     3449  DMBCRAIE         S3. 

3452  DMDCNSC  S4.     3456  DMDCaiC  S6 . 

3480  EARNNEC    14.    3484    TRAININD    SI. 

3465  STACTION    SI.  ; 

LABEL 

ENTRYAGE  =  AGE    CF    INDIVIDUAL    AT    TIME    OF    ENTRY 

REC0FDID=RECOEC    ID — EXAM  SCORE,    DEP,    ACTIVE    DUTY 

HYEC  =HIGHEST    YEAR    OF  EDUCATION 

SEX  =  (1)      MALE,     (2)     FEMALE 

RACE  =nj      WHITE,     j2)     BLACK,     (3)     OTHER 

MRTLB FN D= MARITAL    STATUS/DEPENDENTS 

TESTFORM=TEST    FOR M/E CFA , ASVAB , AFWST , AFQT , OSB. . . 

AFCTFCNT=AFQT    PERCENTILE  (OR    EQUIVALENT) 

AFQTGRPS  =  AFQT    GROUPS     (5  ,4C ,4B , 4A , 3B , 3A , 2, 1 ) 

ASVAEGI    =ASVAE    APTITUDE    AREA    3C0RE--SUBSCALE    GI 
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ASVABNO    =ASVAE    APTITUDE    AREA    S  CORZ--SU  BSCAL  E    110 
ASVAEAD    =ASVAE    APTITUDE    AREA    SCORE — SUBSCALE    AD 
ASVAEWK    =ASVAB    APTITUDE    AREA    S CORE--SU BSCAL £    WK 
ASVAEAR    =ASVAE    APTITUDE    AREA    SCORE — SUBSCALE    AR 
ASVAESP    =ASVAE    APTITUDE    AREA    SCORE--SU BSCAL E    S? 
ASVAEMK    =ASVA£    APTITUDE    AREA    SC0RE--SUB3CALS    KK 
ASVAEEI     =A3VAE    APTITUDE    AREA    SCORE--SU BSCAL E    EI 
ASVAEMC    =ASVAE    APTITUDE    AREA    SCORE — SUBSCALE    MC 
ASVAEGS    =ASVAE    APTITUDE    AREA    SCORE — SUBSCALE    GS 
ASVAESI    =ASVAE    APTITUDE    AREA    SCORE — SUBSCALE    SI 
ASVAEAI    =ASVAB    APTITUDE    AREA    SC0RE--SU3SCAL E    AI 
SEEVACCS=SER7ICE    OF    ACCESSION     (NAVY, 2) 
PRIORSRV=PRIOB    SERVICE     (NON-PRIOR    SERVICE,  1) 
ASVAECM    =ASVAE    APTITUDE    AREA    SCORE — SUBSCALE    CM 
ASVAECA     =ASVAB    APTITUDE    AREA    SCORE  —  SUBSCALE    CA 
ASVAECE    =ASVAE    APTITUDE    AREA    SCORE — SUBSCALE    CE 
ASVAECC    =ASVAB    APTITUDE    AREA    S C0RE--SU3SC AL E    CC 
TERMENLT=TERM    OF    ENLISTMENT    (NO.     OF    YEARS) 
ENIRPAYG  =  ENTRY    PAY   GRADE     (fiOO--Ol1) 
PECGENLT=PROGRAM    ENLISTED    FOR--SERVICS    UNIQUE 
BCNUSOPT=BONUS    OPTION,    COMBAT     OR    NON-COMBAT 
EKLSTOPT=ENLISIMENT    OPTION 

YCDTHPRG=YOUTH    &    RESERVE    TRAINING    PROGRAMS 
TAPEEATE=MONTH    OF    FILE    ON    WHICH    RECORD    SUBMITTED 
TRENLMOS=OCCUE.    SPECIAL. /RATING    CHOICE    UPON    ENTRY 
TAFMS1       =MONTHS   OF   TOTL.    ACTIVE    FED.    MILIT.    SERV. 
DFCC1         =D.O.D.    PRIMARY    OCCUPATION    CODE 
DCCC1         =D.O.C.    DUTY    OCCUPATION    CODE 
HYEC1         =HIGHEST    YEAR    OF    EDUCATION 

PAYGRDE1=PAY    GRADE    A S-O F-DATE-OF-FILE/SEPAR ATION 
SERVICE1=SERVICE    CODE     (2,     NAVY) 
MBTSTAT1=MARITAL    STATUS     (1, OTHER,    2, HARRIED) 
NDPNDNT1=NUMBER   OF    DEPENDENTS     (1,    NONE) 
SENSPD1     ^SEPARATION     PROGRAM    DESIGNATOR 
ISC1  =INTER-SERVICE    SEPARATION    CODE 

SEFRT1YR=YEAR    CF    SEPARATION     (2ND    DMDC    SECTION) 
SEPRT1MT=M0NTH   OF    SEPARATION     (2ND    DMDC    SECTION) 
SEPRT1DY  =  DAY    Cr    SEPARATION     (2ND    DMDC    SECTION) 
EASD1YR    =YEAR    OF    ACTIVE    DUTY    BASS    DATE 
EASD1MTH=M0NTH   OF    ACTIVE    DUTY    BASE    DATS 
EASD1DAY=DAY    CF    ACTIVE    DUTY    BASE    DATE 
STS1YEAR=ESTIMATED    YEAR    OF    FULFILLED    ACTIVE    DUTY 
EIS1MNTH=ESTIMATED    MONTH    OF    FULFILLED    ACTIVE    DUTY 
CHARSRV1  =  CHARACTER    OF    SERVICE 
ELGREUP1=REENIISTMENT    ELIGIBILITY 
PEED1YR    =YSAR    OF    PAY     ENTRY    BASE    DATS 
P£BD1MTH  =  M0NTH    OF    PAY    ENTRY    BASS    DATE 
PEED1DAY=DAY    CF    PAY     ENTRY    BASE    DATS 
ENTRYYR    =YEAR    CF    ENTRY    TO    ACTI VS/D.  E,  ? . 
ENIRYMTH=MONTH   OF    ENTRY    TO    ACTIV  E/D  .  E.  ?. 
ENTEYDAY=DAY    OF    ENTRY    TO    ACTI V E/D. E. P. 
SZPRT1YR=YEAR    OF    SEPARATION    (2ND    DMDC    SECTION) 
SEPRT1MT=M0NTH    OF    SEPARATION     (2ND    DMDC    SECTION) 
SFPRT1DY  =  CAY    OE    SEPARATION     (2ND    DMDC    SECTION) 
BA3D1YR    =YSAR    OF    ACTIVE    DUTY    BASS    DATE 
EASD1MTH  =  M0NTH    OF    ACTIVE    DUTY     BASE    DATE 
EASD1CAY=DAY    OB    ACTIVE    DUTY    BASE    DATE 
ETS1YEAR=ESTIMATED    YEAR    OF    FULFILLED    ACTIVE    DUTY 
ETS1MNTH=SSTIMATED    MONTH    OF    FULFILLED    ACTIVE    DUTY 
PEED1YR    =YEAR    CF    PAY    ENTRY    BASS    DATE 
P£ED1MTH  =  M0NTH   OF    PAY    ENTRY    BASS    DATE 
PEBD1DAY=DAY    CF    PAY    ENTRY    BASE    DATS 
FIIEFLG1  =  FILE    FLAG    NO.     1 
PEED2YR    =YEAR    CF    PAY    ENTRY    BASE    DATE 
PEED2MTH  =  M0NTH   OF    PAY    ENTRY    BASE    DATE 
PEED2DAY=DAY    CF    PAY    ENTRY    BASE    DATE 
SEPRT2YR=YEAR    OF    SEPARATION    (3RD    DMDC    SECTION) 
SEPRT2MT=M0NTH   OF    SEPARATION     (3RD    DMDC    SECTION) 
SEPRT2DY  =  DAY    OP    SEPARATION     (3RD    DMDC    SECTION) 
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EASD2YI?    =YEAR    CF    ACTIVE    DUTY    BASE    DATE 

BASD2MTH  =  M0NTH    OF    ACTIVE    DUTY     BASE    DATE 

EASD2CAY=DAY    OP    ACTIVE    DUTY    BASE    DATE 

EIS2YEAR=ESTIMATED    YEAR    OF    FULFILLED    ACTIVE    DUTY 

ETS2MNTH= ESTIMATED    MONTH    OF    FULFILLED    ACTIVE    DUTY 

PEED2YR    =YEAR    CF    PAY    ENTRY    BASE    DATE 

PEBD2MTH=M0NTH    OF    PAY    ENTRY    BASE    DATE 

PEBD2DAY=DAY    CF    PAY    ENTRY    BASE    DATE 

TAFMS2      =MONTHS   OF   TOTL.    ACTIVE    FED.    MILIT.     SERV. 

DPCC2  =D.O.C.    PRIMARY    OCCUPATION    CODE 

DC0C2         =D.O.C.    DUTY    OCCUPATION    CODE 

HYEC2         =HIGHEST    YEAR    OF    EDUCATION 

PAYGRCS2=PAY    GRADE    A S-OF-DATE-OF-FILE/SEPAR ATION 

SERVICE2=SERVICE    CODE     (2,     NAVY) 

MRTSTAT2=MARITAL    STATUS     (1, OTHER,     2, MARRIED) 

NDPNDNT2  =  NUMBER    OF    DEPENDENTS     (1,    NONE) 

SPNSPD2    =SEPA3ATI0N    PROGRAM    DESIGNATOR 

ISC2  =INTER-SERVICE    SEPARATION    CODS 

CHARSRV2=CHARACTER    OF    SERVICE 

EIGREUP2= RE  ENLISTMENT    ELIGIBILITY 

FIIEFLG2  =  FILS    FLAG    NO.     2 

PFED3YS    =YEAR    CF    PAY    ENTRY    BASE    DATE 

PEED3«TH  =  M0NTH    OF    PAY    ENTRY    BASE    DATE 

PEED3DAY=DAY    OF    PAY    ENTRY    BASE    DATS 

SEPRT3YR=YSAR    CF    SEPARATION     (UTH    DMDC    SECTION) 

SEreT3MT=M0NTH    OF    SEPARATION     (4TH    DMDC    SECTION) 

SEPRT3DY=DAY    CF    SEPARATION     (UTH    DMDC    SECTION) 

HASD3YR    =YEAR    C?    ACTIVE    DUTY    BASE    DATE 

BASD3MTH=M0NTH    OF    ACTIVE    DUTY    BASS    DATS 

BASD3DAY=DAY    CF    ACTIVE    DUTY    BASE    DATE 

ETS3YEAR=ESTIMATED    YEAR    OF    FULFILLED    ACTIVE    DUTY 

ETS3MNTH=ESTIMATED    MONTH    OF    FULFILLED    ACTIVE    DUTY 

PEED3YR    =YSAR    OF    PAY     ENTRY    BASE    DATE 

PEBD3MTH  =  M0NTH    OF    FAY    ENTRY    BASE    DATE 

PEBD3DAY=DAY    OF   PAY     ENTRY    BASE    DATS 

TAFMS3      =MONTHS   OF    TGTL.    ACTIVE    FED.     MILIT.     SERV. 

TAFMS4      =MONTHS   OF   TOTL.    ACTIVE    FED.     MILIT.     SERV. 

DPCC3         =D.O.D.    PRIMARY    OCCUPATION    CODS 

DCCC3         =D.O.D.    DUTY    OCCUPATION    CODE 

HYEC3         =HIGHEST    YEAR    OF    EDUCATION 

PAYGRDE3=PAY    GRADE    A S-OF-D ATE-OF-FILE/SEPAR ATION 

SEBVICE3=SERVICE    CODE     {2,     NAVY) 

MRTSTAT3  =  MARITAL    STATUS     (1, OTHER,    2, MARRIED) 

NCENDNT3=NUMBEB   OF    DEPENDENTS     (1,     NONE) 

SPNSPD3    =SEPARATION     PROGRAM    DESIGNATOR 

ISC3  =INTEF-SERVICE    SEPARATION    CODE 

CHARSRV3=CHARACTER    OF    SERVICE 

ELGREUP 3= RE  ENLISTMENT    ELIGIBILITY 

FIIEFLG3=FILE    FLAG    NO.     2 

FIISMTCH=a-BYTE    BINARY    FILE    MATCH    INDICATORS 

DCEYREEP=DOE    YEAR    INTO    D.E.P. 

DCEMTDEP=DOE     MCNTH    INTO    D.E.P. 

MNIHSDEP=MONTHS    IN    D.E.P. 

SPFLGML    =SPANISH    FLAG    MASTER/LOSS 

CCPGKNTH=MONTH    OF    DCPG 

DCPGYR       =YEAR    CF    DCPG 

GCT  =EASIC    BATTERY    GCT 

ART  =BASIC    BATTERY    ART 

MECH  =EASIC    BATTERY    MECH 

CLEE  =BASIC    BATTERY    CLER 

ENEC  =NAVY    ENLISTED    JOB    CODE 

C'rZNSHIP=CITIZENSHI?    CODE 

E5CL  =£RANCH/CLASS 

GROUPIND=GROUP    INDICATOR 

AUTHRATE=  AUTHORIZED    RATE     (A33R.) 

EDFGYR      =EFFECIIVE    DATE    OF    PAY    GRADE 

SCHLC0DS=SCHOCL    CODE 

SCHLViVR    =SCHOCI    WAIVER 

PEESRATE=PRESENT    RATE    CODE 
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FRETAERV=PRESEKT    RATE     (ABBR.) 

EXAMHATS=  EXAMINATION    RATE    CODE 

EXBTABRV=EXAMINATION    RATE     (ABBR.) 

TCTLRAW    =TOTAL    RAW    SCORE 

STDNAVY    =STANDAEDIZED    NAVY    SCORE 

F5C0DE      =FHOCESS    CODE 

ALTPRCDE=ALTEFNATE    PROCESS    CODE 

FINLMULT  =  CANDIEATE' »  S    FINAL    MULTIPLE 

FNMLTCUT  =  FINAI    MULTIPLE    CUT 

PFFFACTR=PERFCEMANCE    FACTOR 

AWIFACTR=AWI    FACTOR 

CENGRATE=CHANGE   OF    RATE    INDICATOR 

NENLSTMT=NUMBER    OF    ENLISTMENTS 

EAOS  =EXPIRATION    OF    ACTIVE    OBLIGATED    SERVICE 

TAS  =TOTAL    ACTIVE    SERVICE 

CAS  =OTHEB    ACTIVE    SERVICE 

SIFG  =SERVICE    IN     FAY    GRADE 

LCSCCDE    =LENGTH   OF    SERVICE 

LCSWVR       =LENGIH    OF    SERVICE    WAIVER 

TIBWVR      =TIMS    IN    RATE    WAIVER 

TIR  =TIME    IN    RATE 

AEED  =ACTIVF    DUTY    BASE    DATE 

EDFG  =EFFSCTIVE    DATE    OF    PAY    GRADE 

CTIS  =DRILI    TIME    IN    SERVICE 

NCHANGES=NUMBER   0?    CHANGES/ENTRIES    IN    NHRC    FILE 

AGE  =CANDICATS»  •  S    CURRENT    AGE 

NHRCGCT    =NHRC    FILER'S    GENRL.     CLASSIFICATION    TES_ 

NHRCAFQT=NHRC    rILE"S    ARMED   FORCES    QUALIFY.     TEST 

MEKTLGR?=MENTAI   GROUP    CODE 

EDCEBTIF=  EDUCATION    CERTIFICATE 

MOBLDSGN=MILITARY    OBLIGATION    DESIGNATOR 

HYNDFNDT=HIGHEST    NUMBER    OF    PRIMARY    DEPENDENTS 

GFF4FR0G  =  GROUP    IV     (100K)     PROGRAM    CODE 

SSCUTY      =SEA-SHOEE    DUTY    INDICATOR 

REGRESRV=REGUIAR    RESERVE    INDICATOR 

HYFAYGRD=aiGHEST    PAY    GRADE 

NOTRCMD    =NOT    RECOMMENDED    FOR    RE-ENLISTMENT 

SSNCHNGE  =  SOCIAL   S  ECU  RITY/NAi^E    CHANGE 

TCIPROMO=TOTAI    PROMOTIONS 

TCTLDEMO=TOTAL    DEMOTIONS 

TCTLAWOL=TOTAL    UA/AWCL 

TCTDESRT=TOTAI    DESERTIONS 

TCTMLTCN  =  TOTAI    MILITARY    CONFINEMENTS 

TCTCVLCN=TOTAL    CIVILIAN    CONFINEMENTS 

LNGTHSRV=LSNGTH   OF    SERVICE 

SCREEN       =SCREEN    SCORE 

ATTRITCD=ATTRITION    INDICATOR 

R5CNTC      =RECRUIT    NAVAL    TRAINING    COMMAND 

RECENLST=RECROIT    TYPE    ENLISTMENT 

RECPRCGM=HECRUIT    PROGRAM    AT    ENLISTMENT 

RECPRGSC=RECRDIT    PROGRAM/SCHOOL 

ECFGSCRT=RECRaiT    PROGRAM/SCHOOL    RATS 

EISTHIST=ENLISTED    HISTORY    STATUS 

NEAYSE2    =COMPnTED    NUMBER    OF   DAYS    TO    E- 2    RATING 

NEAYSE3     =COMPGTED    NUMBER    OF    DAYS    TO    E-3    RATING 

NEAYSE4    =COM?DTED    NUMBER    OF    DAYS    TO    E- '4    RATING 

DCLE1YR    =YEAR    CF    LATEST    RE-ENLISTMENT 

DCIE1MTH=M0NTH    OF    LATEST    RE-ENLISTMENT 

DCLE2YR    =YEA3    OF    LATEST    RE-ENLISTMENT 

DCIE2MTH=M0NTH    OF    LATEST    RE-ENLISTMENT 

D0LE3YR    =YEAR    CF    LATEST    RE-ENLISTMENT 

DCIE3MTH=M0NTH   OF    LATEST    RE-ENLISTMENT 

DMCCRATS=FINAI    RATING    AS    LISTED    BY    D.M.D.C. 

DMDCNEC    =FINAL    N.E.C.     AS    LISTED    BY    D.M.D.C. 

DMDCUIC    =FINAI    U.I.C.     AS    LISTED    BY    D.M.D.C. 

CCNVEATE=CONVENING    DATE    FOR    NITRAS    COURSE 

GRADCATE=GRADUATION     DATS    FOR    NITRAS    COURSE 

TRANEATE=TRANS  ACTION    DATE    FOR    NITRAS    RECORD 

EAENNEC    =DID    CANDIDATE    EARN    AN    NEC? 
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TRflININD=TRAINING    INDICATOR 

ST 
IP 


STACTION=STUDEUT    ACTION    CODES      (PASS,     P,    ETC.) 
--    DMDCRATE=' SK'    OR     PRSTABR7= • 3H '    OR 


RCFGSCRT=' 2490'     OR    SXAMRATE= ' 2490 • 
FBCC    FREQ; 

TABLES    DMDCPATE    PRRTABRV    RCPGSCRT 

AUTHRATE    PRESRATE    EXAMRATS; 
TITLE    ATTEMPT    AT    FORMING    AN    SH    FILE; 
/* 
// 
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TABLE    XXVII 
Program    Listing  of   Stepwise  Regression   for    SH 


//NESBITTS    JOE     (250  1  ,  01  71 )  ,  •  NE  S3ITT 
//*MAIN    LINES=  (25)  ,0RG=NPGVH1 . 2501P 
//       EXEC     SAS 
//SAS.WORK    DD    SPACE=  (CYL  ,  ( 25,  50)  )  , 

//  DISP=  (NEW, DELETE, DELETE), 

//riLEIN     CD       "    ~"  ~~ 

//SYSIN    DD    * 

OPTICNS    LS=80    NOCENTER 

DATA:SST    FILEIN.  NRATESH 


• ,CLASS=C 

cis?=5HR7DSN=MSs7s2^01 .NRATESH 
NODATE; 


NUMBER    OF    YEARS    OF    EDUCATION    IS    CONVERTED    FBO.^ 
ITS   DMDC   OREINAL  CODING     (1-13)     TO    A    numeric. 


IF 
IF 
IF 
IF 
IF 
IF 
IF 
*    • 


HYEC=1  THEN  CHYEC=3.5;IF  HYEC=2  THEN  CHYEC 
HYEC=3  THEN  CHYEC=9:  IF  HYEC  =  4  THEN  CHYEC  = 
HYEC=5  THEN  CHYEC=11;IF  HYEC=6  THEN  CHYEC= 
HYEC=7  THEN  CHYEC=13;IF  aYEC=8  THEN  CHYSC= 
HYEC=9  THEN  CHYEC=15:IF  HYEC=10  THEN  CHYEC 
HYEC=11  THEN  CHYEC=18;IF  HYEC=12  THEN  CHYE 
HYEC=13    THZN    CHYEC=11.5; 

VALIDITY    VALUE    SCREENS 


=  8; 
10; 
12; 
MX- 

C=20; 


IF  EN 

IF  EN 

IF  SC 

ELSE 

NUATT 

NOATT 

NDNOT 

NUHYF 

YEAR  = 

MONTH 

YEARS 

LCSMN 

If  MC 

ONEYE 

TWCYE 

THRYE 

FORYE 

LABEL 
if 

I  the 


TRYA 
TRY  A 
HLCO 
SCHL 
RIT  = 
RIT  = 
RC  =  N 
AY  =  H 
SUBS 
=SUB 
=YEA 
THS  = 
NTHS 
AR=0 
AR  =  0 
AR  =  0 
AR=0 
LOS 


GE  G 
GE  > 
DE=« 
CODE 
ATTR 
1;EL 
OTRC 
YPAY 
TR(L 
STR  ( 
R+0; 
YEAR 
>  = 

;IF 

;IF 
;IF 
;IF 

MNTH 


F  35 
=  17 
A'  T 

=  '0« 

ITCD 
SE  N 
MC+0 
GRD+ 
NGTH 
LNGT 
MONT 
S*12 
6  TH 
LCSM 
LOSM 
LOSM 
LCSM 
S=TO 


THEN    ENTRYAGE=35; 
;IF    TOTPRO.:iO<=5; 
HEN    SCHLCODE=  M '  : 
;NUSCHCDE=SCHLCODE+0; 
+0;IF    NUATTRIT=2    THEN 
UATTRIT=0; 

6; 

SRV,1.2)  ; 

HSRV,3,2)  ; 

HS=MONTH+0; 

+  MONTHS; 

EN    YEARS=YSARS+1; 


NTHS  >- 
NTHS  >= 
NTHS  >  = 
NTHS    >  = 

TAL    LOS 


12 
24 

36 
48 
IN 


THEN  0NEYSAR=1 
THEN  TW0YEAR=1 
THEN  THRYSAR=1 
THEN  F0RYSAR=1 
.MONTHS     (NUMERIC) 


highest    paygrade    is    dstsrained 


IF 
IF 
IF 
IF 
IF 
IF 
IF 
IF 


TIM 
TIM 
TIM 
TIM 
TIM 
TIM 
LAEE 
TIM 
IIM 
TIM 


ILSFL 

ILEFL 

AYGRA 

AYGRA 

AYGRA 

DAYSS 

EAYSE 

CAYSS 

EE2  =  0 

EE3  =  0 

EE4  =  0 

EE2=  ( 

EE3=  ( 

EE4=  ( 

L 

EE2    = 

EE3    = 

EE4    = 


G1  =  8 
G1  N 
DE>  = 
DE>  = 
DE>  = 

22  =  0 

23  =  0 

24  =  0 


209    THE 
E    8209 

2  THEN 

3  THEN 

4  THEN 
THEN    N 
THEN    N 
THEN    N 


N    PAYGSADE=PAYGRDE1; 
THEN    PAYGRADE=PAYGRDE3; 
NDAYSE22=NDAYSE2;ELSE    NDAYSE22=0 
NDAYSE23=NDAYSE3;ELSE    NEAYSE23=0 
NDAYSS24=NDAYSE4;ELSE    NDAYSS24=0 
DAY3E22=1275 ; 
DAYSS23=1461 ; 
DAYSE24=1750; 


r6un 

ROUN 
ROUN 

ROUN 
ROUN 
ROUN 


(NDA 
(NDA 
(NDA 

DED  NUM 
DED  NUM 
BED  NUM 


YSE22)  /(365/12) 
YSE23)/(365/12^ 
YSE24) /(365/12 


*10)  /10 
*10  /10 
*10    /10 


BER  OF  MONTHS  TO  E2 
BER  OF  MONTHS  TO  E3 
BER    OF    MONTHS    TO    E4; 


1     DEFINES    "ELIGIBILITY    TO    RE-ENLIST". 1 
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IF    FILEFLG1=8209    THEN    ELIGR2UP=1; 
IP     ((EELEFLG1     NE    8209)     AND     (ISC3    GT    0)     AND 
(ELGREUP3    EQ     1))     THEN    EIIG5EUP  =  1  ;  ELSE    ELIGREU?  =  0; 

I    defines    "ACHIEVED    E^U",     IN    JOINT  |     | 

I     CONSIDERATION   OF    THE    D.M.D.C.     AND    N.H.R.C.  | 


(PAYGRADE    GE    U) 
(PAYGRADE    LT    U) 


IF 
IF 
*    • 

I    defLnes    "RAIHD"    VERSUS    "NOT-RATED".  | 


AND     (HYPAYGRD    G2    4))     THEN    ACHVDE4=1; 
OR     (HYPAYGRD    LT    4))     THEN    ACHVDEa=0 ; 


) 


NE     ' 

EQ    2)      A 

U)     AND     ( 

RATED=0; 


AND  (DMDCRATE  NE  '  » 
ND  (SSRVICE1  EQ  2)  AN 
(HYPAYGRD    GE    4)  )  )     THE 


) 
D 

'HEN 


IF  (  (DMDCRATE 
ANC  SERVACCS 
(  (PAYGRADE    GE 

FATZD=1  ;  ELSE 

1    elindnatas    invalid    asvab   subscals   scores    1 


IF 

IF 
IF 
IF 
IF 
IF 
* 


ASVABGI<  =  15;IF 
ASVABWK<=30;IF 
ASVA3MK<  =  20;IF 
ASVABGS<  =  20;IF 
ASVABCM<=3  0;IF 
ASVA3CC<=30: 


ASVABNO<: 

ASVABAR<^ 
ASVABEK 
ASVABSK 
AS VABCA<^ 


=50;  IF 
=20;  IF 

=30  ;  Ix' 
=20;  IF 
=20;  IF 


ASVA3AD<=36 

A3VABSP<=20 
ASVAEMC<=30 
ASVABAI<=20 
ASVA3CE<=30 


es- 

;:abli 

sh 

es 

entry 
entry 

g 

roa 

ps: 

exam 

dmdc 

(2 

yes 

ves 

yes 

ye  s 

yes 

no 

ii' 

ves 

no 

yes 

4 

yes 

no 

no 

b 

no 

yes 

yes 

!^ 

no 
no 

yes 
no 

no 
yes 

IF     ( 

ANC 
IF     ( 

ANC 
IF 

A 
IF     ( 

AND 
IF  ( 
ANI 
IF 

A 

^^    i 

ANC 

«    — 


,ND 


iND 


PCPGS 
CMDCR 
RCPGS 
CMDCR 
RCPGS 

DMDC 
RCPGS 

DMDC 
RCPGS 
DMDCR 
RCPGS 

DMDC 
RCPGS 

DMDC 


CRT  = 

ATE= 

CRT  = 

ATE 

CRT  = 

HATE 

CRT  = 

RATE 

CRT 

ATE= 

CRT 

RATE 

CRT 

RATS 


•2490« 
•SH' )  T 
•2490» 
NE  ' SH' 
'249  0' 
=  » SH  ' ) 
•249  0' 

NE  'SH 
NE  ' 249 
•  *^H'  )  "^ 
NE  '249 

NE  'SH 
NE  '249 
=»SH») 


AND 
HEN 
AND 
)  T 
AND 
THE 
AND 

i'. 

HEN 
0' 

i'. 

THE 


EXAMRAT3='2490 ' 

ENTRYGR?=1: 

SXAMRATS='2490' 
HEN    SNTRYGR?=2; 

EXAMRATE    NE     •2490' 
N    ENTRYGRP=3; 

EXAMRATE    NE     •2490' 
THEN    SNTRYGRP=4 ; 
AND    EXAMRATE='2490' 

ENTRYGRP=5; 
AND    EXAMRATE=«2490' 
THEN    ENTRYGRP=6; 
AND    EXAMRATE    NE    ' 2490' 
N    ENTRYGRP=7; 


NEW    VARIABLE    "DEPNDNTS"    | 


IF    MRTLDPND=10 
MRTLDPND    GT 


T  IT 


THEN    DEPNDNTS=0: 

10    THEN    DEPNDNTS=1; 


GOCDGUY  =  20: 

IF    LCSMNTHS    <    48    THEN    GOODGUY    =10; 
IF    LCSMNTHS    >=    48    AND    RATED=1 
ANC    ELIGREUP=1    THEN    GOODGUY    =30; 
EACGUY=30 ; 

IF    LCSMNTHS    <    48    AND     (ISC3    <=87    AND 

(Y    =1 


ISC3>=60)        THEN    BADGU^ 


IF 
IF 
IF 
IF 
IF 


LOSMNTHS 
LCSMNTHS 
LCSMNTHS 
LOSMNTHS 
LCSMNTHS 


48 
48 
48 
48 
48 


AND 
AND 
AND 
AND 
AND 


0; 

TOTIAWOL 
TOTDESRT 
TOTMLTCN 
TOTCVLCN 
BADGUY=30 


0 
0 
0 

0 


THEN 

THEN 
THEN 
THEN 


BADGUY 
BADGUY 
BADGUY 
BADGUY 


=  10 
=  10 
=  10 
=  10 


THEN    BADGUY    =20 
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I?  LCSM 

IF  LCSM 

LABEL 

DEENENT 

CHYEC 

NUHYFAY 

NDSCHCD 

NUATTRI 

N  UNCI  EC 

NCAYSE2 

NCAYSE2 

NEAYSE2 

ELIGBEU 

ATTRITC 

AITHITC 

PAYGEAD 

ACHVDE4 

RATED 

ENTRYGR 

IE  ENTR 

RAN 

IF  RAN 

IF  3ASD 

ENTR 

I. SCI 

ISC2 

ISC3 

ISC1 

ISC2 

ISC3 

ISC1 

ISC2 

ISC3 

SEX= 

FFCC  S 

BY  R 

EBCC  ST 

BY  RAC 

MCDEL 

AFQTG 

ASVAEAR 

ASVAB 

ENTRY 

SCREE 

TITLE 

BY  RA 

// 


NTHS  >=  48  AN 
NTHS  >=  43  AN 


D  TOTLDEMO  >  0  THEN  BADGUY  =20 
D  SLIGREUP  =  0  THEN  BADGUY  =20 


I.C 

IF 
IF 
IF 
IF 

IF 
IF 
IF 
IF 
IF 
IF 


S=SING 
=  CONV 
=  NHRC 

E  =  ADVA 

T=NHRC 
=  NHRC 

2=SCRE 

3  =  SCRE 

4  =  SCRE 
P=ELIG 
2  =  DMDC 
3=DMDC 
E=CaDC 

=  DMDC 
=  ACCE 
P  =  7  EN 
YGRP  N 
D  N  UM 1  = 
DNUM1= 
1YR  <  = 
YGRP    N 


> 
> 
> 
> 
> 
> 
> 
> 
> 


16 
16 
16 

33 

33 
33 

42 
42 
42 

1  ;  *    SE 

ORT; 

ACE: 

EPWISE 

E  • 

l6smnt 

RPS    AS 

ASVAB 
SI  ASV 
AGE    CH 

n   depn 

STEPW 
CE    SH 


LF,    NO 
ERTED    N 
FILS-- 
NC2MENT 
FILE— 
--NOT    R 
ENED    NU 
EKED    NU 
ENED    NU 
lELE    TO 
-EASED 
-BASED 
-EASED 

S    NHRC 
SSED    & 
TRY    GRO 
E    4; 

FCUND(2 
0    THEN 
78    OR 
E    4; 
OR   ISC1 
ISC2 
ISC3 
I  SCI 
ISC2 
ISC3 
I  SCI 
ISC2 
ISC3 


KIDS    0/OT 
UMBER    OF 
HIGHEST    P 

FILE — ' • 
ATTRITION 
ECOMMENDE 
MBER  OF  D 
MBER  OF  D 
MBER    OF    D 

RE-ENLIS 
STANDARD 
NEGATIVE 
HIGHEST    F 

CCNCORDA 
MOST  RECE 
UPS,    NHRC 


HERS  1 
YEARS 
AYGRAD 
A'  •  SC 
CODES 
D  FOR 
AYS  TO 
AYS  TO 
AYS  TO 
T 

ATTRIT 
ATTRIT 
AY-GRA 
NT  S-4 
NTLY  N 
/EXAMR 


OF    EDUCATION 
E    ATTAINED 
HOOL    COMPLETED 

RE-ENLISTMENT 
E-2 
E-3 
E-4 

ION  MEASURE 
ION  MEASURE 
DE    ATTAINED 

ACHIEVED 
AVY~MADE    E-4 
ATS/DMDCRATE; 


*UNIFORM(12354)  )  ; 
RANDNUM1=2; 
(3ASD1YR    =    78    AND 


CR 
OR 
CR 
CR 
OR 
CR 
CR 
CR 


<  10;* 

<  10;  * 

<  10;* 

<  30;* 

<  30;* 

<  30;* 

<  40;* 

<  40;  * 

<  40;* 


MEDICAL 

MEDICAL 

MEDICAL 

DEATHS 

DEATHS 

DEATHS 

OFFICER 

OFFICER 

OFFICER 


3ASD1MTK    <=    9) 

DISCHARGES; 
DISCHARGES; 
DISCHARGES: 

DISCHARGEES; 
DISCHARGEES ; 
DISCHARGEES; 

ENTRANTS; 
ENTRANTS ; 
ENTRANTS; 


lECTS    ONLY    MALES 


HS    GOODGUY    BADGUY=    AFQTPCNT 

VA3GI    ASVA3N0    A3VA3AD  ASVABWK 

SP    ASVABMK    ASVA3EI    ASVABMC    ASVABGS 

AEAI    ASVABCM    ASVABCA    ASVA3CE    ASVA3CC 

YEC    ENTRPAYG    MRTSTAT1 

DNTS /STEPWISE; 

ISS    SELECTION    OF     PREDICTORS 

SAMPLE; 
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TABLE    XXVIII 
Program  Listing   to    Outpu-   5    Cross   Validate 


//NESEIT 
//*MATN 
//      EXEC 
//SAS.WO 

// 

//fILEIN 
//FT3  1F0 
//  DI 

//FT32F0 
//  DI 

//FT33F0 
//  CI 

//FT34F0 
//  DI 

// 

//SYSIN 

data;  set 

0NEY2AR= 

TWCYEP.R= 

THFYEAR= 

FOfiYEAR= 

IF    SEX=1 

DATA    TRI 

IF    HACE> 

DATA    DIE 

DATA    EER 

DATA    VAL 

PROC    REG 

LCSMNTH 

SCREEN 

ASVAECC 

TITLE    MO 

PRCC    REG 

LCSMNTH 

SCREEN 

ASVABCC 

TITLE    MO 

FRCC    SCO 

CATA=VAL 

ASVAECA 

ASVABCC 

PRCC    SCO 

EATA=CER 

ASVAECA 

ASVAECC 

PRCC    COR 

TITLE  A 
PRCC    COR 

TITIE  A 
PRCC    SCO 

i:ata=cif 

ASVAECA 

ASVABCC 
PROC  SCO 
CATA=all 
ASVAECA 
ASVABCC 
DATA  TAB 
PRCICTOR 


TS    JOB 
LINES  = 

SAS 
RK    DD 
DIS 

DD      D 
01    DD 
SP=(NE 
DCB=  (R 

0  1    DD 
SP=(NE 
DCE=  (R 

01  DD 
SP=(NS 
DC3=  (R 
01  DD 
SP=(NS 
DCE=  (R 
DD    * 

filei 
0;IF  L 
0;  IF  L 
0;  IF  L 
0;  IF  L 
;*  SEL 
ALDAT; 
=  0;*  S 
FRNTZ; 
IV8;SE 
ID8;SE 

DATA  = 
S=ENTR 
MRTSTA 

ASVAB 
DEL    AL 

DATA  = 
S=ENTR 
MRTSTA 

ASVAB 
DEL  AL 
RE  OUT 
IDS    PR 

SCREE 

ASVAB 
RE  OUT 
IV3  PR 

SCREE 

ASVAB 
R  DATA 
LOSM 
LL  SHS 
R  DATA 
LOS.^ 
LL  SHS 
RE  OUT 
FRNTZ 

SCREE 

ASVAB 
RE  OUT 
pr  ed    P 

SCREE 

ASVAB 
LEjSET 
=  (LOSM 


(2501, 
(25)  ,0R 

SPACE=( 
P=(NEW^ 
ISP=SHR 
DNIT=33 
W,CATLG 
ECFM=FB 
UNIT=33 
lv,CATLG 
£CFM=FB 
UNIT=33 
W,CATLG 
ECFM=F3 
aNIT=33 
W,CATLG 
£CFM=FB 

n. urate 
CSMNTHS 
OSMNTHS 
CSMNTHS 
CSMNTHS 
ECTS    ON 

SET    DA 
ELECTS 

SET  TR 
T  DIFFR 
T  DIFFR 
DERIV8 
YAGE  AS 
II  ENTR 
MC  A3VA 
I  SHS  F 
VALID8 
YAGE  AS 
T1  ENTR 
MC  ASVA 
L  SHS  F 
=E01PRE 
EDICT  : 
N  MRTST 
MC  ASVA 
=E02PRE 
EDICT  ; 
N  MRTST 
MC  ASVA 
=  301  PRE 
NTHS  LO 
FIRST 
=E02PRE 
NTHS  LO 
SECON 
=  ALLPRS 
PREDICT 
N  MRTST 
MC  ASVA 
=TWOPRE 
REDICT; 
N  MRTST 
MC    ASVA 

TWOPRE 
1HAT+L0 


C171)  ,  'NESBITT 
G  =  NFGVM1.  2501P 


' ,CLASS=C 


CYL,  r2 

DELETE 
.DSN=M 
30  V,  MS 
) ,DSN= 
.LRECL 
30V, MS 
)  ,D3N  = 
-LRECL 
30V, MS 
) ,DSN= 
.LRECL 
30V, MS 
)  ,DSN= 
, LRECL 


5,50)) 

,DELET 
SS.S25 
VGP=PU 
MSS.S2 
=80, 3L 
VGP=?U 
MSS. S2 
=80, BL 
VGP=PU 
MSS.S2 
=80, BL 
VGP=PU 
MSS.S2 
=80, BL 


r 

E) 

01 .NRATESH 

B4Z, 

501  .SHLMN, 

KSIZE=3120) 

BUZ, 

501.SHLWH, 

KSIZE=3120) 

B4Z, 

501  .SHL3L. 

KSIZE=3120) 

BUZ, 

501.SHLOTe 

KSIZE=3120) 


12 
24 
36 

48 


TH 
TH 
TH 
TH 


sh; 

>= 

>= 

>  = 

>= 

LY    MALES; 
TA  1  * 

ALL 'races 
lALDAT; 
NTZ;IF    RA 
NTZ;IF    RA 
SIMPLE    OU 
VABGI    A3V 
PAYG    ASVA 
BAR    AFQTG 
CR    TOTAL 
SIMPLE    OU 
VABGI    ASV 
PAYG    ASVA 
EAR    AFQTG 
CR    TOTAL 
D    TYPE=OL 

VAR  ENTR 
ATI  ENTRP 
BAR  AFQTG 
D    TYPE=OL 

VAR    ENTR 
ATI    ENTRP 
BAR    AFQTG 
D;VAR 
SM1HAT: 

VALIDITY 
D;  VAR 
SM2HAT; 
D  VALIDIT 
D  TYPE=OL 
;  VAR  ENT 
ATI  ENTRP 
BAR  AFQTG 
D    TYPE=OL 

VAR    ENTR 
ATI    ENTRP 
BAR    AFQTG 
D; 
SM2HAT)/2 


EN  0N£YEAR=1 
EN  TW0YEAR=1 
EN  THRYEAR=1 
EN    F0RYEAR=1 


NDNU 

NDNU 

TEST 

ABAI 

3GS 

RPS 

LOS 

TEST 

ABAI 

BGS 

RPS 

LOS 

S    SC 

YAGS 

AYG 

RPS 

S    SC 

YAGE 

AYG 

EPS 


M1>1; 
M1  =  1; 

=  B01; 

ASVA 
ASVAB 
DEFND 
SAMPL 
=  B02; 

ASVA 
ASVAB 
DEPND 
SAMPL 
CRE  =  B 

ASVA 
ASVAB 
DEPND 
ORE  =  B 

ASVA 
ASVAB 
DEPND 


L0SM1 HAT: MODEL 

3CA 

AD 

NTS/STB; 

E   ONE; 

L0SM2HAT: MODEL 

EC  A 

AD 

NTS/STB; 

E    TWO; 

01 

BGI     ASVABAI 

GS    ASVAEAD 

NTS; 

02 

3GI     aSVABAI 

GS     ASVABAD 

NTS; 


COEFFICIENT; 


Y    COEFFICIENT; 

S    SCORE=B01 

RYAGE    ASVA3GI     ASVABA: 

AYG    ASVABGS     ASVABAD 

RPS    DEPNDNTS; 

S    SCORE=302 

YAGE    ASVA3GI     ASVABAI 

AYG     ASVABGS    ASVABAD 

RPS    DEPNDNTS; 
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FBCC    SORT;  BY    PRDICTOR; 

TITLE      SORTING    BY    PRDICTOE    FOR    ALL    SH    MEN; 

EATA    STORE:SET    TABLE;FILE    FT31F001; 

PUT     (FORYEAR    PRDICTOR    THRYSAR    RACE)      (10.7)  ; 

CATA    TRIALEAT;     SET    DATA1; 

IF    RACE^I:*   SELECTS    WHITES    SHS ; 

EATA    DIFFRNTZ:     SET    TRIALDAT; 

EATA    EERIV8;SET    DIFFRNTZ;IF    RANDNUM1>1; 

DATA    VALID8;3ET    DIFFRNTZ;IF    RANDNUM1=1; 

PRCC    REG    DATA=CZRIV8     SIMPLE    OUTEST  =  B0 1 ; LOS M 1  HAT : MOD  EL 

LCSMNTHS=ENTRPAYG    ASVABGI    AS7ABAI    ASVABMC    SCREEN 

MRTSTAT1     AFQTGRPS    DEPNDNTS/   STB; 
TITLE    MODEL    WHITE    SHS     FOR    LOS    SAMPLE    ONE: 
PROC    REG    DATA=VALID8     SIMPLE    OUTEST  =  B02; L0SM2HAT : MOD  EL 

LCSMNTHS=ENTRPAYG    ASVABGI    ASVABAI    ASVABMC    SCREEN 

MRISTAT1     AFQTGRPS    DEPNDNTS/   STB; 
TITLE    MODEL    WHITE    SHS    FOR    LOS    SAMPLE    TWO: 
PRCC    SCORE    OUT=B01?RED    TYPE=OLS    SCORE=B01 
DATA=VALID8    PREDICT    ;     VAR         ENT3PAYG    ASVABGI    ASVABAI 
ASVABMC    SCREEN    MRTSTAT1     AFQTGRPS    DEPNDNTS; 
PROC    SCORE    OaT=E02PRED    TYPE=OLS    SCORS=B02 
DAIA=DERIV8    PREDICT    :     VAR         2NTRPAYG    ASVABGI    ASVABAI 
ASVAEMC    SCREEN    MRTSTAT1     AFQTGRPS    DEPNDNTS; 
PROC    CORR    DATA  =  E01PRED;VAR 

LOSMNTHS    L0SH1HAT; 
TITLE    WHITES  FIRST    VALIDITY    COEFFICIENT; 

PRCC    CORR    DATA  =  E02PRED;  VAR 

LOSMNTHS    L0SM2HAT: 
TITLE    WHITES  SECOND    VALIDITY    COEFFICIENT; 

PRCC    SCORE    OrJT^ALLPRED    TYPE=OLS    SCORE=B01 
EATA=EIFFRNTZ    PREDICT     :     VAR         ENTRPAYG    ASVABGI    ASVABAI 
ASVABMC    SCREEN    MRTSTATi     AFQTGRPS    DEPNDNTS; 
PRCC    SCORE    OUT=TWOPRED    TYPE=OLS    SCORE=B02 
EATA=allpred    PREDICT     ;    VAR         ENTRPAYG    ASVABGI    ASVABAI 
ASVAEMC    SCREEN    MRTSTATI    AFQTGRPS    DEPNDNTS; 
DATA    TABLE:SET    TWOPRED; 
PRDICTCR=  (LOSMlHAT+LOSM2HAT)/2; 
PRCC    SORT;  BY    PRDICTOR; 

TITLE      SORTING    BY    PRDICTOR    FOR    WHITE      SH    MEN; 
EATA    STORS:SET    TABLE; FILE    FT32F001; 
PUT     (FORYEAR    PRDICTOR    THRYEAR    RACE)      (10.7)  ; 
DATA    TRIALDAT;     SET    DATA1; 
IF    RACE=2:*    SELECTS    BLACKS  ; 

DATA    DIFFRNTZ;     SET    TRIALDAT; 
DATA    DERIV8;SET    DIFFRNTZ;IF    RANDNUM1>1; 
DATA    VALID8;SET    DIFFRNTZ;IF    RANDNaM1=1; 
PRCC    REG    DATA=DERIV8     SIMPL  E    OUTE3T  =  B0  1 ;  LOSM  1  H  AT:  MCDEL 

LCSMNTHS= ASVABCA    SCREEN    MRTSTATI     ASVABCC    AFQTGRPS/ST3 ; 
TITLE    MODEL    SH    BLACKS    FOR    LOS       SAMPLE    ONE; 
PECC    REG    DATA=VALID8     SIMPLE    OU TEST=B 02; L0SM2H AT: MCDEL 

LCSMNTHS=ASVABCA    SCREEN    MRTSTATI     ASVABCC    AFQT  GRPS/STB ; 
TITLE    MODEL    SH    BLACKS     FOR    LOS       SAMPLE    TWO; 
PRCC    SCORE    OUT=E01PRED    TYPE=OLS    3CORS=B01 
CATA=VALID8    PREDICT;     VAR    ASVABCA    SCREEN 
MRTSTATI     ASVABCC    AFQTGRPS; 

PROC    SCORE   OUT=£02?RED    TYPE=OLS    3CORE=B02 
DATA=DERIV8    PREDICT;     VAR    ASVABCA    SCREEN 
MRTSTATI     ASVABCC    AFQTGRPS; 
PRCC    CORR    DATA  =  E01PRED;VAR 

LOSMNTHS    L0SM1HAT; 
TITLE      BLACKS       FIRST    VALIDITY    COEFFICIENT; 
PRCC    CORR     DATA  =  E02?RED;VAR 

LOSMNTHS    L0SM2HAT: 
TITLE      BLACKS       SECOND    VALIDITY     COEFFICIENT; 
PRCC    SCORE    ODT=ALLPRED    TYPE=OLS    SCORE=B01 
DATA=DIFFRNTZ    PREDICT;    VAR    ASVABCA    SCREEN 
MRTSTATI     ASVABCC    AFQTGRPS; 

PROC    SCORE    OUT=TWOPRED    TYPE=OLS    SCORE=B02 
DATA=ALLPRED    PREDICT;     VAR    ASVABCA    SCREEN 
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MFISTATI     ASVABCC    AFQTGEFS; 

CATA    TABLE;SET    TWOPRED; 

PRDICTOR= (LOSMlHAT+LOSM2HAT)/2; 

PRCC    SORT:  BY    PRDICTOR; 

TITLE      SORTING    EY    PRDICTOB    FOR    BLACK    SH    MEN; 

DATA    STORE;SET    TABLE; FILE    FT33F001; 

PUT     (FORYEAR    PREICTOR    THRYSAR    RACE)      (10.7) ; 

DATA    TRIALDAT;     SET    DATA1; 

IF    RACE=3;*    SELECTS    OTHERS    SHS ; 

DATA    EIFFRNTZ;     SET    TRIALDAT; 

DATA    DERIV8;SET    DIFFRNTZ;IF    RANDNUM1>1; 

DATA    VALID8:SET    DIFFRNTZrlF    RANDNUM1=1; 

PROC    REG    DATA  =  DERIV8    SIMPLE    OUTEST=B0  1 ;  LOSM  1  HAT:  MODEL 

LCSMNTHS=ilSVAEGI    ASVABAR    ASVABGS    ASVABMC    ENTRYAGE 
ASVABAD/    STE; 
TITLE    MODEL    OTHERS    SHS    FOR    LOS    SAMPLE    ONE; 
PRCC    PEG    DATA=VALID8    SIMPLE    OaTEST=B0 1 ; L0SM2HAT: MODEL 

LCSMNTHS=ASVABGI    ASVABAR    ASVABGS    ASVABMC    ENTRYAGE 
ASVABAD/    STE; 
TITLE    MODEL    OTHERS    SHS    FOR    LOS    SAMPLE    TWO; 
PRCC    SCORE   OUT=E01PRED    TYPE=OLS    SCORE=B01 
DATA=VALID8    PREDICT    ;     VAR  ASVABGI    ASVABAR 

ASVAEGS    ASVABMC    ENTRYAGE    ASVABAD; 
PRCC    SCORE    OaT=E02FRED    TYPS=OLS    SCORE=B02 
CATA=CERIV8    PRIEICT    ;     VAR  ASVABGI    ASVABAR 

ASVABGS    ASVABMC    ENTRYAGE    ASVABAD; 
PRCC    CORR    DATA  =  E01PRED;VAR 

LOSMNTHS    L0SH1HAT; 
TITLE      OTHERS  FIRST    VALIDITY    COEFFICIENT; 

PRCC    CORR    DATA  =  E02PRED;VAR 

LOSMNTHS    L0SM2HAT; 
TITLE      OTHERS  SECOND    VALIDITY    COEFFICIENT; 

PRCC    SCORE   OUT=ALLPPED    TYPE=OLS    SCORE=B01 
DATA=DIFFRNTZ    PREDICT     ;     VAR  ASVABGI    ASVABAR 

ASVABGS    ASVABMC    ENTRYAGE    ASVABAD; 
PRCC    SCORE    OUT='IWOPRED    TYPE=OLS    SCORS=B02 
DATA=ALL?RED    PREDICT     ;     VAR  ASVABGI    ASVABAR 

ASVABGS    ASVABMC    ENTRYAGE    ASVABAD; 
DATA    TABLE;SET    TWOPRED; 
PREICTOR= (L0SM1HAT+L0SM2HAT) /2 ; 
PRCC    SORT;  BY    PRDICTOR; 

TIILE      SORTING    EY    PRDICTOR    FOR    OTHER    SH    MEN; 
DAIA    STORE;SET    TABLE; FILE    FT3UF001; 
PUT     (FORYEAR    PREICTOR    THRYSAR    RACE)      (10.7)  ; 
/* 
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TABLE    XXIX 
Program  Listing  of   FOHTRAH   Program   for   Cut-offs 


* 

* 
* 
* 


10 
20 


50 


REAL    PASS  (4000) 
RETURN  (3,4 
SUCALL  (3)  , 
UTILSF  (2[  , 
S  (4000)  ,R( 
UTILSP/-92 
UTILSF/144 
E  =  3. 
0 
0 
0    J=  1  ,  3 

=  0.0 
=  0.0 
=  0.0 
=  0.0 
I)  =0.0 
(J,!)  =30.0 
K(J,1)  =0.0 
N  (J.H-  1)=0 
I)  =0.0 
T     (4  F  10.7) 


EATA 

EATA 

SINGL 

C=55. 

E  =  25. 

CO    10 

1=1 

PASSA 

PASSB 

FAILA 

FAILB 

EASS( 

SCORE 

EETDR 

RETDR 

RACE( 

FORMA 

I=I-H 

READ(J, 10,END=5 


,SC 
000 
RAC 
SCO 
400 
44. 
95. 


SF  (2) 


ORE  (3,400  0)  , PAS ST  (4000)  , 
) ,TOTRET (3 ,3) ,N?L0T(3) 
E(4  000)  .SRALL  (3)  ,aTIL 
MAX  (3,z[ ,TOTSC  (3,3) , 
0)  ,TMS(3)  ,TMR  {3\ 
-18483.0/ 
0,-14495./ 


.0 


109 


31 


33 


77 


25 
34 


53 

38 


PA 
GO 
CC 

NP 

GT 
FA 
X  = 

x= 

BA 
N= 
HR 
FO 
DO 
IF 
FA 
FA 
GO 
PA 
FA 
X= 

x= 
x= 

IF 
EA 
IF 
BE 
GO 
RE 
IF 
ES 
IF 
IF 
SC 
SC 
SR 
IF 
SU 
SO 
IF 


0)  P 

P 

+  PASS(I 


SSA  =  PASSA 

TO    2  0 
NTINUE 
LOT  (J)=I-1 
0TAL=I-2 
ILA=GT0TAL-PA 
PASSA*UTILSP( 
X+FAILA*UTILS 
SEUT=X/GTCTAL 
NPLOT  (J) 
ITE  (6,109)  J,G 
RMAT  (I4,F10.3 

40     1=2,  N 

(PASS(I)  )     31 
IL3=FAxLB-H 
ILA  =  FAILA-1 

TO    3  3 
SSB=PASS3  +  1 
SSA  =  PASS  A-1 
FASSA*UTILSF( 
X-^FAILA*UTILS 
X/GTOTAL 

(BASEUT.  KE.O 
SEDT=X 


SSA 
2)^ 
F(2 


TOT 
,F1 


ASS  (I)  , SCORE  (J, I)  , 
A3ST(I)  ,RACS  (I) 


PASSB*UTILS?  (1) 
) +FAILB*UTILSF  (1) 


AL.EASEUT,  JI 
0.2,18) 


(X.NE.  0. 
TURN  (J, 1  + 

TO    2  5 
TORN  (J, 1  + 
(BASEUT.  G 
TURN  (J, 1  + 

(I.EO.  2) 

(RETURN  ( 
CMAX  (J, 2) 
CMAX  (J, 1) 
ALL(J)=(  ( 

(SRALL(J 
CALL  (J)  =0 
CALL  (J)  = 

(RETUR 


n! 


)  GO 
1)=0 

1)=1 

T.O. 
1)=- 

GC  T 
J,I+ 

=  RET 

=sco 

PASS 
)  .GT 
.0 

(PAS 
J, I) 


f  O      I       f    -^   4^ 


2)  +?ASSB*UTILSP  (1) 
F(2)  +FAILB*UTILSF(1) 

.0)  GO    TO    77 

TO     77 


00*  (X-BASEOT) /(BASEUT) 

0[GO    to    25 

RETURN  (J,  1+1) 

0    34 

1)  .  LT.  SCOMAX  (J,2)  )  GO    TO 

URN  (J, I) 

RE(J,I) 

A+F  AHA)  /GTOTAL)  *100 

.0. 0) GO    TO    53 

SA)  /  (PASSA  +  FAILA)  )  *100 
.GT.-20.0)     GO    TO    40 
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00  10 
00  20 
00  30 
00  40 
0050 
0060 
0070 

00  80 
0090 
0100 

01  10 
0120 
0130 
0140 
0150 
0160 
0170 
0180 
0190 
0200 

02  10 

02  20 
0230 
0240 
C2  50 
0260 
0270 
0280 
C2  90 
0300 

03  10 
03  20 
0330 
0340 
0350 
03  60 
0370 

03  80 
0390 

04  00 
04  10 
0420 
0430 
0440 
04  50 
0460 
0470 
04  80 

04  90 
0500 

05  10 
0520 
0530 
0540 
0550 
0560 
0570 

05  30 
0590 
0600 

06  10 
06  20 
06  30 
06  40 
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40 


100 


EETURN 

CCNTIN 

TOTSC 

TOTSC 

lOlSC 

TOTEET 

lOTRET 

TOTEET 

E  =  E-U  . 

CGNTIN 

CALL    T 

CALL 

CALL 

CALL 

CALL 

CALL 

CALL 

CALL 

CALL 


=-20.0 

SCOMAX  ( 
SCOMAX  ( 
D 

=-20.0 
=  SCOMAX 
=  E 


J,1 
J,1 


(J,  2) 


UE 

EK618 

LOWUP 

X1ALP 

X2ALF 

TICKS 

TICKS 

AGE 

REA2D 

NAME 


DARD 
TD»  ,'  +♦) 


/M 


CALL  YNAME     <'P+ERC 

^  p 

CALL  HEADIN     ('SH    M 

* 


ENT 

ROM 

+  EN 

C  + 

CALL   HEADIN     ("R  +  ACE    / 

/S  + 

/-\ 


150 


155 
160 


120 

110 
130 


200 


CALL 
CALL 
DO    20 
N  =  NFL 
DO    15 

im 

IF  (I 
TMS  I 
IMR  I 
CCNTI 
IF  (J 
IF  (J 
CALL 
GO  TO 
CALL 
CALL 
CALL 
CALL 
CALL 

IF  (J.EQ.n 
IF  (J.EQ.2) 
CALL  RLMESS 
GO  TO  1  30 

CALL  RLMESS 
GO  TO  1 30 
CALL  RLMESS 
CALL  RLREAL 

CALL  RLMESS 
CALL  RLREAL 
CALL  RLMESS 
CONTINUE 
D=5.0 
E  =  -5.0 
CALL  RLMESS 
CALL  RLMESS 


HEADIN 
GRAF  ( 
0  J=1, 
OT  (J) 
0  1=1, 
SCORE  ( 
RETURN 
.GT.3) 
) =TOTS 
) =TOTR 
NUE 
,EQ.  1) 
.  EQ.  2) 
DASH 
160 
DOT 
CURVE 
CURVE 
HEIGHT 
RLMESS 


('F+OR 
30,5 


,70 


ON    /P+REDICTOR 
/E+QUATION' ,36) 
AGE    /C+HANGE 

/B+ASE    /R+ATE' ,39) 

ON    /LOS 
RITERION' ,26,-1 .,3) 
S+PECIFIC 

ELECTION* ,28,-1 .,3) 
-•-LL   /SH    M  +  EN*  ,19,-1  .  ,3) 
0,  10,30) 


N 

Orl) 
(J, I)       , 

GC   TO    1 
CjJ,I) 
FT  (J, I) 

GC   TO    1 
GO    TO    1 


(S,R,N, 
(IMSjTM 
(.09) 
(»M+AX 

GO  TO 
GO  TO 
('0+TH 


50 


60 
55 


0) 
R,3,0) 

IMUM    /R+ETURN:     ' , 19, 

TOTSC  (J,  3)  ,TOTRST  (J,3)  ) 
110 
120 
ERS«,7,«  ABUT*  , •  iBUT') 


(•B+LACKS',7,' ABUT*  ,  '  ABUT') 


'W+HI 

SCOMA 

TOT 

SCOMA 
'%',1 


('SELF 
(♦PSRC 


DO    30  0    J=1  ,3 

D  =  C-2.0 

E=E-2.0 

IF     (J.EQ.  1)     GO    TO 


TSS* .7,' ABUT* , • ABUT') 

X(J^nr2. 

SC  (0,3) +2.  ,T0TRST(J,3)  -2.) 
,• ABUT'     • ABUT') 
X(J,2) ,2, 'ABUT' , 'ABUT') 
,' ABUT', • ABUT') 


CTION    RATIOS: ',  17,55.0,0) 
SNTAGE    SUCCESSFUL:', 

22, 55.0,E) 


310 


0650 
0660 
06  70 
06  80 

06  90 
0700 

07  10 
0720 
07  30 
0740 
07  50 
C760 
0770 

07  80 
0790 

08  00 
0810 
03  20 
0830 
0840 
0850 
0860 
0870 
08  80 

08  90 

09  00 
0910 
09  20 
09  30 
09  ao 
0950 
0960 
0970 
09  80 

09  90 
1000 
1010 

10  20 
1030 
10  40 
1050 
1060 
1070 

10  80 
1090 
1100 

11  10 
1120 
1130 
1140 
1150 
1160 
1170 
1180 
1190 
1200 
1210 
1220 
1230 
1240 
1250 
1260 
1270 
1280 
1290 
1300 
13  10 
1320 
1330 
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320 


310 


300 


IF     (J 

CALL 
CALL 
CALL 

CALL 

CALL 

CALL 

GO    TO 

CALL 

CALL 

CALL 

CALL 

CALL 

CALL 

GO    TO 

CALL 

CALL 

CALL 

CALL 

CALL 

CALL 

CONTI 

CALL 

CALL 

STOP 

END 


.  EQ.2) 

R  L  ME  S  S 

REALNO 

RLMESS 

R  L  ME  S  S 

REALNO 

RLMESS 

3  00 
RLMESS 
REALNO 
RLMESS 
RLMESS 
REALNO 
RLMESS 

3  00 
RLMESS 
REALNO 
RLMESS 
RLMESS 
REALNO 
RLMESS 
NUE 
ENDPL 
DONEPL 


GO    TO     320 
•       0^-THER    /G+ROUP    :%18,55.0,D) 
(SRALL  (J)  ,1  ,  'ABUT*  ,  •ABUT*) 
•%'r 1 ,'ABUT', • A3UT') 

O^-THER    /G+ROaP    :  ♦  ,  18  ,55  .  0  ,  E) 
(SUCALL(J)  ,  1,' ABUT*  ,  •  ASQT') 


(•%*, 1 ,' ABUT*,' ABUT') 


(•       B+LACK    /G+ROUP 
(SRALL  (J)  ,1  ,  'ABUT' 


• ,18,55.0,D) 
,.,    «^.x    ,     ABUT') 
,  .  ,    «BUT', • ABUT') 
'       B+LACK   /G+ROU?    :  •  ,  18  ,55  .  0  ,  E) 
SUCALL  (Ji  ,  1,' ABUT'  ,  '  ABUT') 
'%',  1  ,'ABUT*  -  '  ARriT*- 


ABUT') 


W^HITE   /G+ROUP    : 

(SRALL  (J)  ,1  ,  'ABUT'  ,  ' 

^•^',  1  ,' ABUT'  ,'  ABUT' 

•       W+HITE    /G+ROUP    : 

iSUCALL(J)  ,  1  ,'ABUT' 


' ,13.55 
A3UTM 


1 


(J),1,'A 
'ABUT*,' 


ABUTh 


,13,55 
ABUT') 


0,D) 

0,E) 


(C) 


1340 
1350 
1360 
1370 
1380 
1390 
1400 
1410 
1420 

14  30 
1440 
1450 
1460 
1470 
1480 
1490 
1500 

15  10 
1520 
15  30 
15  40 
1550 
1560 
1570 
1580 
15  90 
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APPENDIXES 
STEPWISE    REGRESSION    RESULTS    FOR    RATINGS 

This     appendix  gives      the      results      of  the      stepwise 
regressions.  They    are      presented    in      the      form    of      rating 

specific  tables.  As  these  tables  were  constructed  directly 
from  computer  output  the  variables  all  have  the  SAS  names 
that  were  used  in  the  analysis.  Therefore,  interested 
readers  ar9  directed  to  the  relevant  sections  of  the 
preceding  SAS  program  listings  to  determine  exactly  which 
variables  are  listed.  In  all  cases  the  variables  and  their 
coefficient  signr  correspond  to  the  tables  in  the  body  of 
the    thesis    which   lists  the    stepwise   regression  results. 
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TABLE    XXX 
All   SH    Stepwise   Regression   Besalts 

SH   Whi-tes   on    Length  of    Service 

15  ■?     sM-CT'^gTJ  1  Trob>F 

EEGFESSION                  8          16236.804  11.08  0.0001 
EBROR                      1297      237637 
TCTAL                      1305      253874, 

B     VALUE         STD    E  P  PROB>F 
INTEECEFT      26.67C1644 

AFQTGEPS         -0.92C9895       0.3761  5.99  0.0145 

ASVAEMC           -0.2688282       0.1360  3.90  0.0484 

ASVAEAI           -C. 1703922       0.0978  3.03  0.0818 

ASVAECA           -0.1555049       0.0917  2.87  0.0903 

ENTEFAYG             1.7093734       0.8128  4.42  0.0357 

METSTAT1            5.6677671       0.8366  45.89  0.0001 

SCREEN                 0.2465786       0.0607  16.73  0.0001 

EEPNDNTS         -3.8332762       2.1708  3.20  0.0739 

SH   Whites    on    GOODGJY 

DT      ^Tm'"C"P~'S^n  7  PROB>F 

REGEESSION                  4         3022.5064  12.22  0.0001 
ERROR                      1301      80462.1030 
TCTAL                      1305      83484.6094 

B    VALUE          STD    E  F  FEOB>F 
INTEECEFT       1.10711196 

ASVAEMK            0.08789585       0.0561  2.45  0.1174 

ASVAECE         -0.14122207      0.0493  8.18  0.0043 

CHYEC                 1.36078242       0.2466  30.43  0.0001 

WETSTAT1         1.09421802       0.4740  5.33  0.0211 

SH    Whites    on    BADGOY 

DT    sirH~n"F~SDn f  prob>f 

EEGRESSION                 7         4135.7682  12.74  0.0001 
ERROR                      1298      60204.2011 
TCTAL                      1305      6433S.9693 

B     VALUE         STD    E  F  PROB>F 
INTSECEFT    -1.74204431 

ASVAENO            0.03938113       0.0225  3.04  0.0816 

ASVAEWK         -0.12244891       0.0420  8.47  0.0037 

ASVAECE         -0.09038137       0.0428  4.45  0.0352 

CHYEC                 1.20950502       0.2603  21.58  C.0001 

ENTRFAYG         0.90472456       0.4131  4.80  0.0287 

MEISTAT1          1.13491198       0.4115  7.61  0.0059 

SCREEN              0.08475720       0.0359  5.56  0.0186 

SH   Blacks   on    Length  of    Service 

"DT    ^rra^DT'^gn  7  7^03  >f 

REGRESSION                 5         9203.0966  11.26  0.000  1 
EERCB                        552      90267.1439 
TOTAL                        557      99470.2455 

B    VALUE         STD    E  F  PROB>F 
INTEBCSPT      32.7376235 

AFCTGEFS         -1.9561139       0.4563  18.37  0.0001 

ASVABCA           -0.4280135       0.1625  6.93  0.0087 

ASVAECC              0.3140531       0.1357  5.35  0.0211 

MRISTAT1            6.2469389       1.1323  30.43  0.0001 

SCREEN                 0.2155208       0.0872  6.10  0.0138 

SH   Blacks    on    GOODGUY 

DT — STnrT3T"SD17 7  PEOB>F 

REGEESSION                  4           621.0247  3.34  0.0102 
ERROR                        553      25714.4591 
TCTAL                        557      26335.4838 

B     VALUE          STD    E  F  PROB>F 
INTERCEPT       11.4082688 

AFQTGEPS         -0.66  12232       0.2428  7.41  0.0067 
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ASVAECC  0.0992502       0.0590         2.83  0.0931 

ME1SIAT1  1.1435432      0.6035         3.59  0.0586 

SCREEN  0.0855462       0.0460         3.45  0.0639 

SH    Blacks    on    BADGUY 

DT — STJF~'DF~HU'a F  PROE>? 

REGRESSION  4  900.1514         6.76  0.0001 

ERROR  553      13399.6692 

TCTAL  557      19299.8207 

B     VALOE         STD    E  P  PROB>F 

INTERCEPT       11.1996625 

ASVAEAR  -0.2490178       0.0778      10.23  0.0015 

ASVAECC  0.1040409       0.0497         4.38  0.0369 

ENTRYAGE         -0.1948975       0.1156         2.34  0.0926 

CHYEC  1.1681247       0.3167       13.60  0.0002 

SH  Others   en    Length  of   Service 

T7T — Sm'  X^TSm 7 FR  0  B  >  ? 

REGRESSION  6         8636.5314       11.36  0.0001 

ERROR  149      18874.4685 

TCTAI  155      27511.0000 

B     VALUE         STD    E  F  PROB>F 

INTERCEPT       54.9934418 

ASVABGI  -1.1711530       0.3280       12.74  0.0005 

ASVAEAD  -0.33C8399       0.1989         2.77  0.0934 

ASVAEAR  -0.8798285       0.2952         3.38  0.0034 

ASVAEMC  -0.7107025       0.3736         3.62  0.0591 

ASVAEGS  1.1684002       0.3674       10.11  0.0018 

ENTRYAGE  0.6142226       0.3009         4.17  0.0430 

SH  Others    on    GOODGOY 

DF      Sim"!:?"^!^!! 7  PROB>F 

REGRESSION  5         1050.2840         5.95  0.0001 

ERROR  150         5293.3056 

TCTAL  155         6343.5897 

B     VALUE         STD    E  F  PROB>F 

INTERCEPT      8.68073217 

AFQTPCNI      -0.09466851       0.0286       10.93  0.0012 

ASVAEEI         -0.163S4685       0.1001         2.68  0.1039 

ASVAEAI         -0.28815095       0.1548         3.46  0.0647 

ASVAECC  0.38797354       0.1097       12.49  0.0005 

SCREEN  0.14637842       0.0801         3.33  0.0693 

SH  Others    on    BADGUY 

DT      ^Tm""n7~3UTJ F  PHOB>F 

REGRESSION  5  644.5853         4.39  0.0004 

ERROR  150         3952.8505 

TCTAL  155         4597.4358 

B    VALUE         STD    E  F  PROB>F 

INTERCEPT      6.77090112 

AFCTPCNT      -0.161S4490       0.0584         7,67  0.0063 

AFQTGRPS         1.31562114       0.7261         3.28  0.0720 

ASVAEAI         -0.28525384       0.1288         4.90  0.0284 

ASVAECC  0.23515378       0.0952         6.09  0.0147 

CHYEC  0.98156281       0.4234         5.37  0.0218 
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TABLE    XXXI 
All   PN    Stepwise   Regression   Results 

PN    White   M^n  on    Langth  of    Service 

"51     ^im~^~"5^  F  Plo  B  >  F 

REGRESSION                  9         23114.535  14.78  0.0001 
EERCE                      1216      2112U7.111 
TOTAL                      1225      234361.647 

B    VALOE         STD    E  F  PSOB>F 
INTERCEPT      30.6886800 

ASVAEWK           -0.3907675       0.0918  18.10  0.0001 

ASVAEAR           -0.2914101       0.1277  5,20  0.0227 

ASVAEEI              0.2812350       0.1048  7.19  0.0074 

ASVABSI           -0.2984347       0.1175  6.44  0.0113 

ASVAECE              0.1368159       C.0849  2.59  0.1076 

ENTHYAGE            0.3694307       0.1831  4.07  0.0439 

CHYEC                -1.0215411       0.4358  5.49  0.0193 

MRTSTAT1            7.6648584       0.7969  92.49  0.0001 

SCREEN                 0.2812599       0.0781  12.96  0.0003 

PN    White    .len   on    GOODGUY 

"UT — ^Tm""07~"StTJ 7  PR0  3>F 

REGRESSION                  8         2013.1708  5.33  0.0001 
ERROR                      1217      57483.8112 
TCTAL                      1225      59496.9820 

B     VALUE         STD    S  F  ?HOB>F 
INTERCEPT       10.4760049 

ASVAEWK           -0.1122275       0.0443  6.41  0.0115 

ASVAEAR           -0.2167153       0.0682  10.28  0.0014 

ASVABMC              0.0974479       0.0637  2.34  0.1267 

ASVABCE              0.1244157       0.0424  8.58  0.0035 

CHYEC                -0.3040941       0.1929  2.48  0.1154 

MRTSIAT1            0.9357586       0.4190  4.99  0.0257 

SCREEN                 0.16^2128       0.0406  16.33  0.0001 

DEPNDNTS            1.5133497       0.8221  3.39  0.0659 

PN   White    Men   on  3ADGUY 

n?      ?!JH~DF~3^"a  ?  PROB>F 


REGRESSION                 4           626.2016  5.70  0.0002 
EBRCE                      1221      33550.0625 
TOTAL                      1225      34176.2642 

B    VALUE         STD    E  F  PHOB>F 
INTERCEPT       12.9046054 

AFQTGRPS         -0.5259052       0.1598  10.83  C.0010 

ASVABEI              0.0801835       0.0373  4.60  0.0321 

SCREEN                 0.1092251       0.0268  16.54  0.0001 

DEPNDNTS            1.1273538       0.6069  3.45  0.0635 

PN    ElackJIen   on   Lenq-h   of    Service 

HT — STJH~"D7— SUt 7 PI70  B  >  F 

REGRESSION                  6         6750.8674  8.31  0.0001 
EERCE                        276      37349.7756 
TOTAL                         282      44100.6431 

3    VALUE         STD    E  F  ?ROB>F 
INTERCEPT      43.8556818 

AFCTPCNT         -0.1731397       0.0417  17.17  0.0001 

ASVABNO           -0.1314724       0.0864  2.31  0,1295 

ASVAECC           -0-3337261       0.1623  4.23  0.0408 

CHYEC                -2.4543496       0.5735  18.31  0.0001 

MRTSTAT1            5.8937313       1.4492  16.54  0.0001 

SCREEN                 0.4812862       0.1509  10.17  0.0016 

PN    Elack    Men   on   GOODGUY 

"U7      STm~n7~3T3TJ 7  PROB>F 

REGRESSION                 7           950.4489  3.68  0.0009 

ERROR  275      10156.2648 

TOTAL  282      11106.7137 
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INTEHCEFT 

ASVAEGI 

ASVAENO 

ASVAEKK 

ASVABEI 

ASVAESI 

ASVABCE 

CHYEC 


EEG3ESSI0N 

ERROR 

TCTAL 

INTEECEFT 

ASVABSI 

ASVAEAI 

ENTRYAGE 

ENTBFAYG 


B    VALUE 

24.9538629 

0.  3102658 

-0.  1398792 

0.  1769179 

0.  1726309 

-0.  3085155 

-0.  152171  1 
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